-- Logs begin at Wed 2022-06-22 09:33:26 UTC, end at Wed 2022-06-22 10:48:13 UTC. -- Jun 22 10:11:52.557086 dv-cinder-847132-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 22 10:11:52.566177 dv-cinder-847132-1-iscsi devstack@n-api.service[103156]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 22 10:11:52.568120 dv-cinder-847132-1-iscsi devstack@n-api.service[103156]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 22 10:11:52 2022] *** Jun 22 10:11:52.568120 dv-cinder-847132-1-iscsi devstack@n-api.service[103156]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 22 10:11:52.568120 dv-cinder-847132-1-iscsi devstack@n-api.service[103156]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 22 10:11:52.568120 dv-cinder-847132-1-iscsi devstack@n-api.service[103156]: nodename: dv-cinder-847132-1-iscsi Jun 22 10:11:52.568120 dv-cinder-847132-1-iscsi devstack@n-api.service[103156]: machine: x86_64 Jun 22 10:11:52.568120 dv-cinder-847132-1-iscsi devstack@n-api.service[103156]: clock source: unix Jun 22 10:11:52.568120 dv-cinder-847132-1-iscsi devstack@n-api.service[103156]: pcre jit disabled Jun 22 10:11:52.568120 dv-cinder-847132-1-iscsi devstack@n-api.service[103156]: detected number of CPU cores: 4 Jun 22 10:11:52.568120 dv-cinder-847132-1-iscsi devstack@n-api.service[103156]: current working directory: / Jun 22 10:11:52.568120 dv-cinder-847132-1-iscsi devstack@n-api.service[103156]: detected binary path: /usr/bin/uwsgi-core Jun 22 10:11:52.568120 dv-cinder-847132-1-iscsi devstack@n-api.service[103156]: your processes number limit is 47680 Jun 22 10:11:52.568120 dv-cinder-847132-1-iscsi devstack@n-api.service[103156]: your memory page size is 4096 bytes Jun 22 10:11:52.568120 dv-cinder-847132-1-iscsi devstack@n-api.service[103156]: detected max file descriptor number: 2048 Jun 22 10:11:52.568120 dv-cinder-847132-1-iscsi devstack@n-api.service[103156]: lock engine: pthread robust mutexes Jun 22 10:11:52.568975 dv-cinder-847132-1-iscsi devstack@n-api.service[103156]: thunder lock: enabled Jun 22 10:11:52.568975 dv-cinder-847132-1-iscsi devstack@n-api.service[103156]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 22 10:11:52.568975 dv-cinder-847132-1-iscsi devstack@n-api.service[103156]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 22 10:11:52.610670 dv-cinder-847132-1-iscsi devstack@n-api.service[103156]: Python main interpreter initialized at 0x55a23fa389c0 Jun 22 10:11:52.610670 dv-cinder-847132-1-iscsi devstack@n-api.service[103156]: python threads support enabled Jun 22 10:11:52.610670 dv-cinder-847132-1-iscsi devstack@n-api.service[103156]: your server socket listen backlog is limited to 100 connections Jun 22 10:11:52.610670 dv-cinder-847132-1-iscsi devstack@n-api.service[103156]: your mercy for graceful operations on workers is 90 seconds Jun 22 10:11:52.611095 dv-cinder-847132-1-iscsi devstack@n-api.service[103156]: mapped 403077 bytes (393 KB) for 2 cores Jun 22 10:11:52.611095 dv-cinder-847132-1-iscsi devstack@n-api.service[103156]: *** Operational MODE: preforking *** Jun 22 10:11:52.611347 dv-cinder-847132-1-iscsi devstack@n-api.service[103156]: *** uWSGI is running in multiple interpreter mode *** Jun 22 10:11:52.611347 dv-cinder-847132-1-iscsi devstack@n-api.service[103156]: spawned uWSGI master process (pid: 103156) Jun 22 10:11:52.611606 dv-cinder-847132-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 22 10:11:52.614533 dv-cinder-847132-1-iscsi devstack@n-api.service[103156]: spawned uWSGI worker 1 (pid: 103157, cores: 1) Jun 22 10:11:52.614533 dv-cinder-847132-1-iscsi devstack@n-api.service[103156]: spawned uWSGI worker 2 (pid: 103158, cores: 1) Jun 22 10:11:52.614533 dv-cinder-847132-1-iscsi devstack@n-api.service[103156]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 22 10:11:53.267671 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 22 10:11:53.300489 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 22 10:11:54.385681 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 10:11:54.385681 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: from cryptography.utils import int_from_bytes Jun 22 10:11:54.386336 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 10:11:54.386336 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: from cryptography.utils import int_from_bytes Jun 22 10:11:54.388905 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 10:11:54.388905 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: from cryptography.utils import int_from_bytes Jun 22 10:11:54.389385 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 10:11:54.389385 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: from cryptography.utils import int_from_bytes Jun 22 10:11:56.869044 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 22 10:11:56.869758 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 22 10:11:56.869874 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 22 10:11:56.870307 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 22 10:11:56.870426 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 22 10:11:56.870557 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 22 10:11:56.870557 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 22 10:11:56.870781 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 22 10:11:56.870891 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.871005 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 22 10:11:56.871114 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 22 10:11:56.871205 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.871466 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.871608 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.871715 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.871829 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.872041 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.872172 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.872343 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.872460 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.872659 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.872784 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.872971 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.873104 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.873288 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.873413 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.873531 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.873636 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.873834 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.873949 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.874155 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.874281 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847132-1-iscsi {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.874458 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.874597 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.874814 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.875013 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847132-1-iscsi {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.875165 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.875331 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.875493 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.875651 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.875800 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.875941 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.876092 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.876219 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.876342 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.876467 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.876590 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.876907 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.877180 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.877359 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.877559 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.877780 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.877978 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.878154 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.878348 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.878523 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.878683 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.878880 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.879096 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.879322 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.879471 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.879626 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.879836 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.880033 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.880223 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.880445 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.880640 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.880795 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.880953 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.881148 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847132-1-iscsi {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.881354 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.881565 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.881784 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847132-1-iscsi {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.882000 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.882194 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.882381 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.882586 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.882751 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.882902 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.883061 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.883412 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.883637 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.883842 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.884061 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.884247 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.884398 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.884546 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.884693 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.884847 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.885019 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.885159 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.885300 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.885439 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.885578 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.885727 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.885885 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.886026 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.886191 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.886340 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.886616 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.886764 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.886906 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.887053 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.887200 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.887396 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.887622 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.887936 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.888126 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.888353 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.888549 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.888753 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.888969 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.889185 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.889385 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.889598 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.889816 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.890053 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.890273 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.890479 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.890730 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.890730 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.891141 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.891141 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.891562 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.891768 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.891974 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.892239 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.892474 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.892679 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.892893 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.893098 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.893314 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.893655 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.893875 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.894076 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.894287 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.894523 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.894730 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.894948 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.895158 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.895371 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.895592 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.895794 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.896066 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.896347 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.896571 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.896798 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.896997 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.897187 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.897405 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.897603 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.897803 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.898012 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.898214 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.66 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.898416 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.898688 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.66 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.898688 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.899117 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.66 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.899117 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.66 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.899538 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.899756 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.899966 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.900186 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.900393 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.900592 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.900794 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.900995 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.901218 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.901218 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.901625 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.901842 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.902044 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.902248 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.902463 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.902704 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.902908 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.902908 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.903311 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.903522 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.903868 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.903868 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.904269 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.904490 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.904700 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.904919 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.905132 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.905339 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.905554 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.905753 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.905960 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.906172 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.906374 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.906981 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.907200 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.907422 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.907640 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.907862 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.908064 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.908311 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.908536 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.908756 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.908957 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.909170 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.909371 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.909588 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.909792 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.909998 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.910201 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.910438 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.910671 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.910894 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.911098 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.911311 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.911524 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.911750 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.911986 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.912187 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.912404 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.912610 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.912831 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.913051 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.913254 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.913458 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.913675 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.914011 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.914229 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.914428 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.914699 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.914923 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.915137 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.915342 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.915543 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.915762 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.915990 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.916193 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.916390 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.916585 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.916800 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.916999 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.917198 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.917401 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.917619 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.917823 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.918046 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.918251 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.918452 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.918711 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.918913 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.919111 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.919336 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.919553 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.919762 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.919974 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.920175 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.920375 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.920601 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.920805 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.921012 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.921220 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.921433 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.921641 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.921839 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.922036 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.922233 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.922459 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.922736 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.922953 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.923161 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.923392 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.923595 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.923792 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.924041 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.924475 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.924698 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.924900 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.925113 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.925315 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.925540 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.925757 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.925956 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.926157 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.926367 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.926584 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.926802 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.927041 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.927380 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:11:56.927584 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.927781 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.927987 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.928221 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.928447 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.928660 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.928891 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.929097 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.929299 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.929529 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.929743 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.929956 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.930164 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.930393 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.930722 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.930926 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.931134 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.931351 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.931561 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.931758 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.931989 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.932206 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.932410 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.932625 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.932827 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.933027 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.933240 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.933478 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.933706 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.933921 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.934172 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.934532 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.934765 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.934970 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.935180 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.935408 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.935667 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.935894 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.936129 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.936364 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.936569 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.936767 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.936978 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.937209 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.937454 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.937677 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.937882 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.938099 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.938322 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.938588 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.938820 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.939043 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.939244 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.939244 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.939629 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.939848 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.940079 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.940309 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.940524 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.940728 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.940928 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.941155 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.941369 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.941600 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.941799 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.942002 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.942211 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.942423 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.942663 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.942879 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.943086 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.943290 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.943492 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.943706 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.943938 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.944169 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.944377 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.944699 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.944916 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.945124 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.945346 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.945574 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.945777 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.945980 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.946193 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.946392 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.946647 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.946869 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.947071 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.947292 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.947517 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.947721 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.947919 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.948140 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.948362 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.948574 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.948794 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.949014 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.949227 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.949450 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.949692 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.949935 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.950173 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.950399 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.950657 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.950892 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.951102 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.951345 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.951562 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.951783 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.952004 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.952211 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.952427 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.952659 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.952882 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.953108 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.953339 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.953577 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.953808 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.954101 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.954341 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.954597 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.955027 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.955301 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.955520 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.955771 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.955991 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.956225 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.956459 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.956740 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.957074 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.957297 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.957518 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.957738 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.957950 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.958164 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.958407 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.958830 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.959070 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.959291 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.959540 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.959765 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.960016 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.960238 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.960452 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.960671 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.960895 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.961102 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.961330 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.961553 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.961797 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.962020 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.962376 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.962634 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.962853 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.963072 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.963316 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.963536 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.963769 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.964015 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.964231 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.964442 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.964660 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.964897 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.965313 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.965553 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.965780 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.965995 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.965995 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.966428 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.966713 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.966954 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.967188 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.967407 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.967626 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.967847 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.968101 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.968336 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.968544 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.968752 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.968968 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.969202 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.969428 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.969644 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.969876 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.970102 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.970321 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.970564 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.970803 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.971022 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.971241 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.971451 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.971679 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.971892 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.972122 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.972361 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.972593 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.972830 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.973060 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.973320 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.973549 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.973806 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.974034 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.974302 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.974586 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.974834 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.975069 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.975306 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.975689 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.975918 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.976152 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.976389 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.976624 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.976852 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.977110 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.977339 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.977569 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.977800 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.978016 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.978228 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.978404 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.978579 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.978748 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.978898 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.979046 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.979193 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.979373 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.979538 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.979695 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.979845 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.980065 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.980306 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.980531 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.980759 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.980996 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.981208 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.981391 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.981541 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.981688 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.981846 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.982018 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.982167 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.982325 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.982483 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.982695 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.982862 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.983015 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.983214 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.983442 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.983662 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.983904 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.984145 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.984372 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.984629 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.984881 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.985111 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.985333 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.985577 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.985997 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.986248 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.986479 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.986743 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.986952 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.987188 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.987421 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.987632 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.987865 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.988194 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.988422 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.988667 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.988896 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.989132 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.989369 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.989604 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.989921 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.990178 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.990419 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.990759 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.991018 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.991262 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.991500 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.991722 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.991943 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.992239 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.992492 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.992806 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.993056 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.993281 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.993515 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.993751 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.993987 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.994254 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.994528 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.994528 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.994951 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.994951 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.995281 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.995455 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.995612 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.995760 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.995948 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.996234 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.996396 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.996581 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.996760 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.996910 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.997065 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.997213 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.997359 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.997516 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.997516 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.997797 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.997943 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.997943 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.998222 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.998460 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.998697 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.998857 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.998857 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.999136 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.999296 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.999444 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.999592 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.999738 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:56.999884 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.000050 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.000215 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.000372 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.000519 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.000667 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.000824 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.000979 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.001135 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.001283 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.001430 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.001577 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.001732 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.001878 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.002034 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.002181 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.002327 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.002474 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.002662 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.002822 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.002980 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.003127 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.003275 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.003432 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.003580 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.003734 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.003891 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.004045 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.004193 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.004338 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.004484 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.004655 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.004812 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.004959 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.005114 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.005262 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.005456 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.005614 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.005762 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.005908 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.006063 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.006229 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.006494 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.006700 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.006865 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.007014 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.007160 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.007315 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.007471 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.007619 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.007766 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.007913 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.008061 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.008208 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.008390 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.008606 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.008860 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.009127 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.009371 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.009560 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.009719 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.009868 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.010030 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.010183 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.010330 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.010330 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.010654 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.010654 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.010936 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.011095 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.011242 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.011403 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.011552 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.011698 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.011844 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.011990 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.012145 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.012302 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.012451 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.012597 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.012744 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.012891 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.013057 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.013220 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.013388 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.013545 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.013714 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.013863 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.014017 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.014171 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.014320 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.014479 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.014692 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.014840 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.014999 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.015157 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.015305 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.015460 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.015608 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.015755 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.015901 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.016055 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.016203 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.016358 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.016532 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.016769 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.016923 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.017080 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.017227 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.017383 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.017543 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.017692 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.017847 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.017994 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.018149 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.018298 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.018446 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.018618 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.018777 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.018925 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.019093 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.019241 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.019389 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.019537 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.019684 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.019830 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.019986 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.020151 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.020301 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.020457 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.020613 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.020768 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.020955 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.021147 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.021296 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.021443 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.021594 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.021749 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.021898 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.022044 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.022199 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.022346 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.022721 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.022963 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.023115 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.023278 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.023425 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.023572 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.023729 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.023889 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.024040 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.024195 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.024349 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.024496 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.024652 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.024801 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.024955 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.025102 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.025259 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.025405 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.025567 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.025714 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.025863 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.026017 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.026165 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.026319 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.026486 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.026678 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.026883 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.027035 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.027192 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.027353 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.027510 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.027658 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.027804 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.027952 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.028107 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.028263 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.028412 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.028573 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.028722 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.028869 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.029016 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.029171 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.029329 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.029477 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.029625 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.029779 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.029927 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.030090 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.030242 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.030389 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.030603 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.030757 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.030904 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.031062 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.031219 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.031377 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.031836 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.031985 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.032142 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.032289 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.032436 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.032583 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.032753 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.032984 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.033149 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.033297 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.033457 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.033614 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.033778 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.033925 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.034081 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.034230 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.034377 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.034547 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.034701 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.034849 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.035015 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.035163 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.035326 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.035474 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.035639 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.035794 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.035943 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.036090 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.036236 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.036383 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.036529 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.036729 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.036879 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.037035 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.037184 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.037339 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.037495 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.037670 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.037826 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.037980 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.038135 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.038290 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.038444 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.038633 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.038784 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.038931 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.039088 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.039244 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.039400 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.039549 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.039707 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.039860 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.040009 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.040165 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.040321 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.040471 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.040619 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.040766 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.040913 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.041059 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.041218 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.041367 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.041514 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.041671 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.041818 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.041965 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.042121 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.042268 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.042414 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.042610 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.042761 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.042908 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.043154 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.043308 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.043455 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.043602 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.043760 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.043921 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.044070 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.044216 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.044363 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.044509 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.044656 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.044811 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.044959 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.045114 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.045262 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.045408 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.045573 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.045732 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.045880 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.046027 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.046174 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.046328 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.046475 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.046717 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.046901 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.047072 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.047230 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.047386 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.047551 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.047705 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.047856 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.048019 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.048168 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.048329 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.048494 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.048494 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.048494 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.048494 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.049073 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.049233 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.049397 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.049547 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.049690 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.049865 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.050011 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.050158 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.050316 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.050464 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.050658 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.050814 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.050961 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.051122 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.051270 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.051429 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.051607 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.051755 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.051910 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.052174 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.052366 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.052521 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.052670 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.052818 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.052964 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.053128 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.053280 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.053428 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.053571 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.053716 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.053854 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.054007 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.054150 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.054308 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.054463 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.054629 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.054794 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.054942 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.055096 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.055305 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.055451 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.055594 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.055752 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.055897 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.056040 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.056183 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.056339 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.056495 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.056702 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.056851 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.056996 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.057139 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.057280 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.057430 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.057588 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.057743 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.057908 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.058067 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.058213 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.058368 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.058536 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.058683 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.058827 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.058963 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.059124 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.059285 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.059441 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.059587 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.059730 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.059872 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.060013 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.060173 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.060318 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.060462 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.060616 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.060764 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.060909 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.061065 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.061209 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.061355 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.061500 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.061643 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.061795 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.061951 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.062096 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.062263 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.062392 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.062560 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.062725 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.062869 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.063014 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.063160 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.063359 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.063509 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.063668 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.063811 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.063954 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.064149 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.064316 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.064460 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.064603 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.064761 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.064925 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.065068 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.065226 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.065372 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.065537 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.065681 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.065846 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.066001 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.066144 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.066300 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.066458 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.066648 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.066803 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.066949 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.067094 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.067248 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.067398 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.067398 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.067698 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.067698 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.067975 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.067975 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.068242 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.068398 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.068543 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.068685 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.068831 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.068973 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.069180 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.069340 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.069483 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.069638 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.069786 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.069930 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.070087 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.070343 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.070343 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.070633 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.070786 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.070933 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.071104 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.071252 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.071407 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.071553 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.071697 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.071841 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.072001 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.072144 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.072287 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.072431 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.072586 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.072727 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.072886 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.073042 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.073189 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.073345 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.073561 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.073724 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.073867 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.074012 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.074157 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.074300 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.074444 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.074629 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.074774 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.074919 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.075063 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.075220 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.075366 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.075523 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.075668 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.075816 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.075957 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.076098 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.076246 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.076409 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.076554 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.076712 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.076857 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.076999 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.077164 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.077164 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.077448 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.077591 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.077735 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.077887 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.078057 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.078200 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.078345 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.078491 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.078772 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.078920 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.079079 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.079284 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.079434 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.079578 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.079736 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.079881 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.080045 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.080199 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.080199 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.080463 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.080608 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.080767 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.080912 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.081058 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.081212 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.081368 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.081513 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.081672 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.081817 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.081958 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.082103 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.082246 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.082390 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.082569 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.082743 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.082891 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.083033 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.083177 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.083321 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.083481 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.083746 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.083893 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.084046 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.084190 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.084428 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.084588 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.084744 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.084891 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.085049 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.085192 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.085351 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.085494 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.085639 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.085783 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.085928 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.086068 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.086229 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.086373 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.086540 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.086686 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.086831 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.086974 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.087142 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.087301 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.087450 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.087450 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.087717 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.087881 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.087881 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.088194 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.088396 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.088396 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.088667 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.088834 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.088834 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.089111 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.089254 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.089385 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.089539 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.089539 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.089821 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.089963 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.090128 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.090273 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.090273 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.090765 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.090915 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.090915 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.091181 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.091339 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.091339 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.091627 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.091783 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.091783 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.092049 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.092205 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.092205 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.092498 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.092643 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.092811 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.092958 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.092958 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.092958 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.093359 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.093515 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.093515 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.093766 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.093914 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.093914 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.094165 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.094309 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.094309 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.094603 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.094775 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.094775 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.095065 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.095212 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.095212 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.095522 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.095668 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.095812 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.095955 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.095955 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.096224 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.096379 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.096379 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.096657 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.096802 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.096957 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.097217 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.097217 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.097607 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.097753 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.097753 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.098018 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.098162 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.098162 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.098453 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.098684 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.098684 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.098965 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.099126 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.099281 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.099427 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.099427 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.099687 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.099832 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.099832 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.100124 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.100269 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.100269 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.100602 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.100749 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.100915 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.101071 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.101071 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.101334 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.101483 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.101483 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.101764 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.101919 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.101919 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.102185 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.102327 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.102327 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.102688 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.102856 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.102856 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.103133 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.103278 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.103439 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.103584 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.103584 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.103904 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.104102 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.104363 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.104510 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.104510 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.104777 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.104921 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.104921 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.105205 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.105348 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.105348 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.105612 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.105817 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.105817 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.106113 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.106256 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.106256 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.106632 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.106778 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.106778 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.107061 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.107219 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.107361 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.107509 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.107509 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.107795 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.107956 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.107956 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.108220 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.108362 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.108362 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.108677 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.108823 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.108823 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.109088 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.109234 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.109234 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.109510 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.109723 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.109723 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.109723 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.110110 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.110269 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.110269 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.110555 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.110700 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.110700 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.110967 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.111188 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.111188 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.111451 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.111589 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.111589 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.111868 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.112033 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.112033 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.112309 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.112466 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.112611 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.112765 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.112765 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.113051 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.113207 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.113207 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.113469 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.113635 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.113779 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.113936 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.113936 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.114275 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.114429 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.114668 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.114931 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.114931 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.115200 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.115344 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.115344 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.115622 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.115794 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.115794 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.116062 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.116208 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.116208 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.116489 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.116632 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.116632 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.116913 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.117057 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.117213 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.117358 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.117358 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.117358 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.117358 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.117899 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.118064 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.118064 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.118327 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.118472 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.118472 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.118764 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.118929 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.119087 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.119231 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.119231 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.119497 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.119656 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.119656 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.119998 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.120143 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.120143 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.120412 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.120571 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.120571 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.120834 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.120978 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.120978 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.121246 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.121404 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.121550 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.121696 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.121696 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.121958 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.122116 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.122116 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.122396 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.122622 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.122770 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.122912 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.122912 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.123196 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.123343 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.123343 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.123608 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.123753 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.123753 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.124032 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.124229 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.124229 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.124512 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.124667 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.124823 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.124970 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.124970 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.125246 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.125387 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.125387 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.125668 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.125811 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.125811 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.126074 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.126219 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.126219 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.126495 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.126693 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.126839 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.126984 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.126984 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.127276 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.127422 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.127422 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.127691 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.127835 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.127835 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.128119 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.128265 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.128265 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.128530 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.128685 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.128685 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.128979 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.129121 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.129121 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.129389 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.129545 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.129545 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.129835 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.129980 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.129980 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.130244 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.130433 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.130619 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.130776 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.130776 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.131105 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.131249 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.131249 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.131628 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.131775 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.131922 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.132066 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.132066 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.132363 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.132509 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.132509 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.132775 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.132921 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.132921 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.133209 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.133354 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.133499 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.133651 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.133651 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.133917 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.134077 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.134077 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.134396 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.134627 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.134627 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.134929 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.135074 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.135074 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.135340 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.135487 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.135487 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.135772 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.135915 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.135915 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.136179 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.136326 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.136483 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.136649 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.136649 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.136649 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.136649 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.137160 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.137305 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.137305 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.137599 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.137743 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.137743 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.138011 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.138167 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.138167 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.138436 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.138600 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.138600 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.138863 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.139027 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.139172 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.139315 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.139315 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.139582 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.139725 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.139725 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.140005 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.140152 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.140298 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.140443 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.140443 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.140726 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.140880 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.140880 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.141225 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.141369 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.141369 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103158) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 22 10:11:57.141649 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.141649 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.141649 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.141649 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.141649 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.141649 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.141649 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.141649 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.142789 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.142789 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.142789 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.142789 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.142789 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.142789 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.142789 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.142789 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.143826 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.143826 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.143826 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.143826 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.143826 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.143826 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.143826 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.143826 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.144814 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.144814 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.144814 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.144814 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.144814 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.144814 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.144814 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.144814 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.145832 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.145832 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.145832 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.145832 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.145832 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.145832 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.145832 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.145832 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.146962 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.146962 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.146962 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.146962 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.146962 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.146962 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.146962 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.146962 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.147983 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.147983 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.147983 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.147983 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.147983 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.147983 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.147983 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.148867 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.148867 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.149295 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.149713 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.150125 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.150649 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.151004 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.151416 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.151825 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.152230 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.152664 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.153098 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.153516 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.153945 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.154356 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.154808 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.155216 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.155669 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.156099 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.156844 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.157264 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.157705 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.158116 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.158542 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.158964 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.159373 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.159782 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.160187 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.160608 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.161028 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.161438 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.161895 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.162355 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.162851 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.163266 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.163683 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.164107 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.164516 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.164951 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.165368 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.165783 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.166200 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.166681 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.167106 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.167543 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.167965 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.168373 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.168805 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.169226 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.169674 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.170085 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.170573 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.171007 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.171426 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.171835 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.172236 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:11:57.172569 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103157) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 22 10:11:57.240363 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: INFO dbcounter [None req-ee940c8a-f006-4d92-a0bf-11564eb6460e None None] Registered counter for database nova_api Jun 22 10:11:57.272610 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: INFO dbcounter [None req-83c459b7-d910-4c39-abd1-31f85e9a9b48 None None] Registered counter for database nova_api Jun 22 10:11:57.296009 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG oslo_db.sqlalchemy.engines [None req-83c459b7-d910-4c39-abd1-31f85e9a9b48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103158) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 10:11:57.303995 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG dbcounter [-] [103158] Writer thread running {{(pid=103158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 10:11:57.364233 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.context [None req-83c459b7-d910-4c39-abd1-31f85e9a9b48 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),99dc5dbe-6aa5-4c21-a61e-113fd190a23f(cell1) {{(pid=103158) load_cells /opt/stack/nova/nova/context.py:464}} Jun 22 10:11:57.368375 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG oslo_concurrency.lockutils [None req-83c459b7-d910-4c39-abd1-31f85e9a9b48 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:11:57.368585 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG oslo_db.sqlalchemy.engines [None req-ee940c8a-f006-4d92-a0bf-11564eb6460e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103157) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 10:11:57.369972 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG oslo_concurrency.lockutils [None req-83c459b7-d910-4c39-abd1-31f85e9a9b48 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:11:57.370806 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG oslo_concurrency.lockutils [None req-83c459b7-d910-4c39-abd1-31f85e9a9b48 None None] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:11:57.372743 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG oslo_concurrency.lockutils [None req-83c459b7-d910-4c39-abd1-31f85e9a9b48 None None] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:11:57.374824 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: INFO dbcounter [None req-83c459b7-d910-4c39-abd1-31f85e9a9b48 None None] Registered counter for database nova_cell0 Jun 22 10:11:57.375513 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG dbcounter [-] [103157] Writer thread running {{(pid=103157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 10:11:57.379319 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: INFO dbcounter [None req-83c459b7-d910-4c39-abd1-31f85e9a9b48 None None] Registered counter for database nova_cell1 Jun 22 10:11:57.387293 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG oslo_db.sqlalchemy.engines [None req-83c459b7-d910-4c39-abd1-31f85e9a9b48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103158) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 10:11:57.388557 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG oslo_db.sqlalchemy.engines [None req-83c459b7-d910-4c39-abd1-31f85e9a9b48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103158) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 10:11:57.395126 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG dbcounter [-] [103158] Writer thread running {{(pid=103158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 10:11:57.396531 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG dbcounter [-] [103158] Writer thread running {{(pid=103158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 10:11:57.431862 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.context [None req-ee940c8a-f006-4d92-a0bf-11564eb6460e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),99dc5dbe-6aa5-4c21-a61e-113fd190a23f(cell1) {{(pid=103157) load_cells /opt/stack/nova/nova/context.py:464}} Jun 22 10:11:57.435885 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG oslo_concurrency.lockutils [None req-ee940c8a-f006-4d92-a0bf-11564eb6460e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:11:57.437485 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG oslo_concurrency.lockutils [None req-ee940c8a-f006-4d92-a0bf-11564eb6460e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:11:57.438268 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG oslo_concurrency.lockutils [None req-ee940c8a-f006-4d92-a0bf-11564eb6460e None None] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:11:57.440353 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG oslo_concurrency.lockutils [None req-ee940c8a-f006-4d92-a0bf-11564eb6460e None None] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103157) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:11:57.442373 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: INFO dbcounter [None req-ee940c8a-f006-4d92-a0bf-11564eb6460e None None] Registered counter for database nova_cell0 Jun 22 10:11:57.446310 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: INFO dbcounter [None req-ee940c8a-f006-4d92-a0bf-11564eb6460e None None] Registered counter for database nova_cell1 Jun 22 10:11:57.453564 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG oslo_db.sqlalchemy.engines [None req-ee940c8a-f006-4d92-a0bf-11564eb6460e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103157) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 10:11:57.457176 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG oslo_db.sqlalchemy.engines [None req-ee940c8a-f006-4d92-a0bf-11564eb6460e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103157) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 10:11:57.459297 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG dbcounter [-] [103157] Writer thread running {{(pid=103157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 10:11:57.541342 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: INFO dbcounter [None req-83c459b7-d910-4c39-abd1-31f85e9a9b48 None None] Registered counter for database nova_cell0 Jun 22 10:11:57.548823 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG oslo_db.sqlalchemy.engines [None req-83c459b7-d910-4c39-abd1-31f85e9a9b48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103158) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 10:11:57.553891 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG dbcounter [-] [103158] Writer thread running {{(pid=103158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 10:11:57.613485 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG dbcounter [-] [103157] Writer thread running {{(pid=103157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 10:11:57.624266 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: INFO dbcounter [None req-ee940c8a-f006-4d92-a0bf-11564eb6460e None None] Registered counter for database nova_cell0 Jun 22 10:11:57.633968 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG oslo_db.sqlalchemy.engines [None req-ee940c8a-f006-4d92-a0bf-11564eb6460e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103157) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 10:11:57.640432 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG dbcounter [-] [103157] Writer thread running {{(pid=103157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 10:11:57.890812 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: WARNING keystonemiddleware.auth_token [None req-83c459b7-d910-4c39-abd1-31f85e9a9b48 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 10:11:57.898314 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: WARNING keystonemiddleware.auth_token [None req-83c459b7-d910-4c39-abd1-31f85e9a9b48 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 10:11:57.957238 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: WARNING keystonemiddleware.auth_token [None req-ee940c8a-f006-4d92-a0bf-11564eb6460e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 10:11:57.964864 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: WARNING keystonemiddleware.auth_token [None req-ee940c8a-f006-4d92-a0bf-11564eb6460e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 10:11:58.235737 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: WARNING keystonemiddleware.auth_token [None req-83c459b7-d910-4c39-abd1-31f85e9a9b48 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 10:11:58.241959 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: WARNING keystonemiddleware.auth_token [None req-83c459b7-d910-4c39-abd1-31f85e9a9b48 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 10:11:58.247497 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a23fa389c0 pid: 103158 (default app) Jun 22 10:11:58.249788 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-83c459b7-d910-4c39-abd1-31f85e9a9b48 None None] Calling method '>' {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:11:58.251040 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.requestlog [None req-83c459b7-d910-4c39-abd1-31f85e9a9b48 None None] 10.222.0.66 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001966 Jun 22 10:11:58.251480 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: [pid: 103158|app: 0|req: 1/1] 10.222.0.66 () {50 vars in 788 bytes} [Wed Jun 22 10:11:58 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:11:58.304601 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: WARNING keystonemiddleware.auth_token [None req-ee940c8a-f006-4d92-a0bf-11564eb6460e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 10:11:58.310939 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: WARNING keystonemiddleware.auth_token [None req-ee940c8a-f006-4d92-a0bf-11564eb6460e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 10:11:58.316338 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a23fa389c0 pid: 103157 (default app) Jun 22 10:13:16.503109 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-83c459b7-d910-4c39-abd1-31f85e9a9b48 None None] Calling method '>' {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:13:16.504825 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.requestlog [None req-83c459b7-d910-4c39-abd1-31f85e9a9b48 None None] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002258 Jun 22 10:13:16.505553 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: [pid: 103158|app: 0|req: 2/2] 10.222.0.66 () {54 vars in 930 bytes} [Wed Jun 22 10:13:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:13:16.524396 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG dbcounter [-] [103157] Writing DB stats nova_api:SELECT=3 {{(pid=103157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:13:16.526114 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG dbcounter [-] [103157] Writing DB stats nova_cell0:SELECT=3 {{(pid=103157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:13:16.527038 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG dbcounter [-] [103157] Writing DB stats nova_cell1:SELECT=3 {{(pid=103157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:13:16.528046 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG dbcounter [-] [103157] Writing DB stats nova_cell0:SELECT=3 {{(pid=103157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:13:17.258120 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-df62d369-bee4-42cf-9bc0-a2f2957153c7 admin admin] Calling method '>' {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:13:17.307514 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.requestlog [None req-df62d369-bee4-42cf-9bc0-a2f2957153c7 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.793847 Jun 22 10:13:17.314488 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: [pid: 103157|app: 0|req: 1/3] 10.222.0.66 () {60 vars in 1291 bytes} [Wed Jun 22 10:13:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:13:20.075354 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-83c459b7-d910-4c39-abd1-31f85e9a9b48 None None] Calling method '>' {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:13:20.076489 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.requestlog [None req-83c459b7-d910-4c39-abd1-31f85e9a9b48 None None] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001537 Jun 22 10:13:20.077176 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: [pid: 103158|app: 0|req: 3/4] 10.222.0.66 () {54 vars in 930 bytes} [Wed Jun 22 10:13:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:13:20.147605 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-d672527e-f3be-44bf-a819-277a5b6e21ef admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 256, "id": "c1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "disk": 1}} {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:13:20.166283 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 10:13:20.166283 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: warnings.warn(msg) Jun 22 10:13:20.200638 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.requestlog [None req-d672527e-f3be-44bf-a819-277a5b6e21ef admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.116403 Jun 22 10:13:20.214116 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: [pid: 103157|app: 0|req: 2/5] 10.222.0.66 () {64 vars in 1282 bytes} [Wed Jun 22 10:13:20 2022] POST /compute/v2.1/flavors => generated 407 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 10:13:20.621246 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-041bd62c-a3fb-4213-a70b-214eaa0e2e77 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:13:20.624264 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 10:13:20.624264 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: warnings.warn(msg) Jun 22 10:13:20.645187 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG dbcounter [-] [103158] Writing DB stats nova_api:SELECT=3 {{(pid=103158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:13:20.646352 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG dbcounter [-] [103158] Writing DB stats nova_cell0:SELECT=3 {{(pid=103158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:13:20.647523 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG dbcounter [-] [103158] Writing DB stats nova_cell1:SELECT=3 {{(pid=103158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:13:20.648403 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG dbcounter [-] [103158] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:13:20.702555 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.requestlog [None req-041bd62c-a3fb-4213-a70b-214eaa0e2e77 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.485405 Jun 22 10:13:20.703411 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: [pid: 103158|app: 0|req: 4/6] 10.222.0.66 () {64 vars in 1335 bytes} [Wed Jun 22 10:13:20 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:13:23.307326 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-d672527e-f3be-44bf-a819-277a5b6e21ef admin admin] Calling method '>' {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:13:23.308355 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.requestlog [None req-d672527e-f3be-44bf-a819-277a5b6e21ef admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001544 Jun 22 10:13:23.308930 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: [pid: 103157|app: 0|req: 3/7] 10.222.0.66 () {54 vars in 930 bytes} [Wed Jun 22 10:13:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:13:23.446809 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-a703f88a-6b8b-4e2c-9275-def88ca1c1dc admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "d1", "vcpus": 1, "ram": 512, "name": "ds512M", "disk": 5}} {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:13:23.465911 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 10:13:23.465911 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: warnings.warn(msg) Jun 22 10:13:23.490077 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.requestlog [None req-a703f88a-6b8b-4e2c-9275-def88ca1c1dc admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.174172 Jun 22 10:13:23.491022 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: [pid: 103158|app: 0|req: 5/8] 10.222.0.66 () {64 vars in 1282 bytes} [Wed Jun 22 10:13:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 10:13:23.508090 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-0997f9d9-65c2-4c82-9405-f961d128fd8d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:13:23.510009 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 10:13:23.510009 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: warnings.warn(msg) Jun 22 10:13:23.549905 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.requestlog [None req-0997f9d9-65c2-4c82-9405-f961d128fd8d admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045640 Jun 22 10:13:23.550736 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: [pid: 103157|app: 0|req: 4/9] 10.222.0.66 () {64 vars in 1335 bytes} [Wed Jun 22 10:13:23 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:13:25.700480 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-a703f88a-6b8b-4e2c-9275-def88ca1c1dc admin admin] Calling method '>' {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:13:25.701978 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.requestlog [None req-a703f88a-6b8b-4e2c-9275-def88ca1c1dc admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002035 Jun 22 10:13:25.703188 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: [pid: 103158|app: 0|req: 6/10] 10.222.0.66 () {54 vars in 930 bytes} [Wed Jun 22 10:13:25 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:13:25.777776 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-d3c765ea-b1da-4edb-86df-da90f4a74b3f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "os-flavor-access:is_public": true, "ram": 1024, "rxtx_factor": 1.0, "name": "ds1G"}} {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:13:25.800760 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.requestlog [None req-d3c765ea-b1da-4edb-86df-da90f4a74b3f admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.089687 Jun 22 10:13:25.801352 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: [pid: 103157|app: 0|req: 5/11] 10.222.0.66 () {64 vars in 1282 bytes} [Wed Jun 22 10:13:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 10:13:25.826094 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-da16a6e7-92fe-4ae2-adad-0947a4c0aa6b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:13:25.864661 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.requestlog [None req-da16a6e7-92fe-4ae2-adad-0947a4c0aa6b admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046977 Jun 22 10:13:25.865346 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: [pid: 103158|app: 0|req: 7/12] 10.222.0.66 () {64 vars in 1335 bytes} [Wed Jun 22 10:13:25 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:13:28.769605 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-d3c765ea-b1da-4edb-86df-da90f4a74b3f admin admin] Calling method '>' {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:13:28.770947 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.requestlog [None req-d3c765ea-b1da-4edb-86df-da90f4a74b3f admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001760 Jun 22 10:13:28.771681 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: [pid: 103157|app: 0|req: 6/13] 10.222.0.66 () {54 vars in 930 bytes} [Wed Jun 22 10:13:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:13:28.847403 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-2b6edfff-cd07-49ba-b729-d9d687c6e21c admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "name": "ds2G", "disk": 10, "vcpus": 2, "ram": 2048, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:13:28.870009 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.requestlog [None req-2b6edfff-cd07-49ba-b729-d9d687c6e21c admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.091212 Jun 22 10:13:28.870679 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: [pid: 103158|app: 0|req: 8/14] 10.222.0.66 () {64 vars in 1282 bytes} [Wed Jun 22 10:13:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 10:13:28.884932 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-73602c31-8826-44ec-b9cc-0e67888c0bf1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:13:28.914334 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.requestlog [None req-73602c31-8826-44ec-b9cc-0e67888c0bf1 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033514 Jun 22 10:13:28.915123 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: [pid: 103157|app: 0|req: 7/15] 10.222.0.66 () {64 vars in 1335 bytes} [Wed Jun 22 10:13:28 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:13:31.118440 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-2b6edfff-cd07-49ba-b729-d9d687c6e21c admin admin] Calling method '>' {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:13:31.119679 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.requestlog [None req-2b6edfff-cd07-49ba-b729-d9d687c6e21c admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001665 Jun 22 10:13:31.120853 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: [pid: 103158|app: 0|req: 9/16] 10.222.0.66 () {54 vars in 930 bytes} [Wed Jun 22 10:13:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:13:31.199493 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-bd2700d4-5754-4f9d-8122-f5616ca287b6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "swap": 0, "os-flavor-access:is_public": true, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "vcpus": 4, "id": "d4", "rxtx_factor": 1.0}} {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:13:31.225260 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.requestlog [None req-bd2700d4-5754-4f9d-8122-f5616ca287b6 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.096483 Jun 22 10:13:31.226439 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: [pid: 103157|app: 0|req: 8/17] 10.222.0.66 () {64 vars in 1282 bytes} [Wed Jun 22 10:13:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 10:13:31.240641 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-a734cfe4-5ec6-4118-8304-e48ebd067627 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:13:31.271261 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.requestlog [None req-a734cfe4-5ec6-4118-8304-e48ebd067627 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034478 Jun 22 10:13:31.272146 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: [pid: 103158|app: 0|req: 10/18] 10.222.0.66 () {64 vars in 1335 bytes} [Wed Jun 22 10:13:31 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:13:33.524784 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-bd2700d4-5754-4f9d-8122-f5616ca287b6 admin admin] Calling method '>' {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:13:33.525814 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.requestlog [None req-bd2700d4-5754-4f9d-8122-f5616ca287b6 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Jun 22 10:13:33.526214 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: [pid: 103157|app: 0|req: 9/19] 10.222.0.66 () {54 vars in 930 bytes} [Wed Jun 22 10:13:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:13:33.593516 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-0a4dadb1-80fd-4355-98da-b8aa88a5ed02 admin admin] Calling method '>' {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:13:33.637879 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.requestlog [None req-0a4dadb1-80fd-4355-98da-b8aa88a5ed02 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.104106 Jun 22 10:13:33.639748 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: [pid: 103158|app: 0|req: 11/20] 10.222.0.66 () {60 vars in 1291 bytes} [Wed Jun 22 10:13:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:13:36.611881 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-bd2700d4-5754-4f9d-8122-f5616ca287b6 admin admin] Calling method '>' {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:13:36.613680 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.requestlog [None req-bd2700d4-5754-4f9d-8122-f5616ca287b6 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002667 Jun 22 10:13:36.614414 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: [pid: 103157|app: 0|req: 10/21] 10.222.0.66 () {54 vars in 930 bytes} [Wed Jun 22 10:13:36 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:13:36.720143 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-cb3f93ee-5a6c-4a9b-9c2a-7c8d2f3411a1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "1", "vcpus": 1, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 512}} {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:13:36.750515 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.requestlog [None req-cb3f93ee-5a6c-4a9b-9c2a-7c8d2f3411a1 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.125386 Jun 22 10:13:36.751740 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: [pid: 103158|app: 0|req: 12/22] 10.222.0.66 () {64 vars in 1282 bytes} [Wed Jun 22 10:13:36 2022] POST /compute/v2.1/flavors => generated 402 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 22 10:13:36.775646 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-c67358d6-65a0-4fa6-bf6c-1d4e85b60cb1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:13:36.810736 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.requestlog [None req-c67358d6-65a0-4fa6-bf6c-1d4e85b60cb1 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038355 Jun 22 10:13:36.812577 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: [pid: 103157|app: 0|req: 11/23] 10.222.0.66 () {64 vars in 1332 bytes} [Wed Jun 22 10:13:36 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:13:39.021504 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-cb3f93ee-5a6c-4a9b-9c2a-7c8d2f3411a1 admin admin] Calling method '>' {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:13:39.022680 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.requestlog [None req-cb3f93ee-5a6c-4a9b-9c2a-7c8d2f3411a1 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001570 Jun 22 10:13:39.023312 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: [pid: 103158|app: 0|req: 13/24] 10.222.0.66 () {54 vars in 930 bytes} [Wed Jun 22 10:13:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:13:39.097952 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-bbe5adb4-40c0-44e5-b750-4758281e4e90 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 20, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "name": "m1.small"}} {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:13:39.124791 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.requestlog [None req-bbe5adb4-40c0-44e5-b750-4758281e4e90 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.095072 Jun 22 10:13:39.125469 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: [pid: 103157|app: 0|req: 12/25] 10.222.0.66 () {64 vars in 1282 bytes} [Wed Jun 22 10:13:39 2022] POST /compute/v2.1/flavors => generated 405 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 22 10:13:39.139774 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-6f55fc6c-2c86-420c-91f4-49c7e57d9f39 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:13:39.175744 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.requestlog [None req-6f55fc6c-2c86-420c-91f4-49c7e57d9f39 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040923 Jun 22 10:13:39.176583 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: [pid: 103158|app: 0|req: 14/26] 10.222.0.66 () {64 vars in 1332 bytes} [Wed Jun 22 10:13:39 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:13:41.453619 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-bbe5adb4-40c0-44e5-b750-4758281e4e90 admin admin] Calling method '>' {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:13:41.454869 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.requestlog [None req-bbe5adb4-40c0-44e5-b750-4758281e4e90 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001593 Jun 22 10:13:41.455423 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: [pid: 103157|app: 0|req: 13/27] 10.222.0.66 () {54 vars in 930 bytes} [Wed Jun 22 10:13:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:13:41.527112 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-909f0d55-83fb-44e5-8e76-fb137f914b35 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "id": "3", "vcpus": 2, "ram": 4096, "rxtx_factor": 1.0, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:13:41.555326 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.requestlog [None req-909f0d55-83fb-44e5-8e76-fb137f914b35 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.092937 Jun 22 10:13:41.556095 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: [pid: 103158|app: 0|req: 15/28] 10.222.0.66 () {64 vars in 1282 bytes} [Wed Jun 22 10:13:41 2022] POST /compute/v2.1/flavors => generated 406 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 22 10:13:41.572787 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-7029a296-f0c1-432f-9dcc-ed7c14507711 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:13:41.607142 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.requestlog [None req-7029a296-f0c1-432f-9dcc-ed7c14507711 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038889 Jun 22 10:13:41.608067 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: [pid: 103157|app: 0|req: 14/29] 10.222.0.66 () {64 vars in 1332 bytes} [Wed Jun 22 10:13:41 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:13:43.766318 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-909f0d55-83fb-44e5-8e76-fb137f914b35 admin admin] Calling method '>' {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:13:43.768401 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.requestlog [None req-909f0d55-83fb-44e5-8e76-fb137f914b35 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002672 Jun 22 10:13:43.769385 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: [pid: 103158|app: 0|req: 16/30] 10.222.0.66 () {54 vars in 930 bytes} [Wed Jun 22 10:13:43 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:13:43.859742 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-9f854b36-090e-4ff1-95f8-5d37e5bcc49a admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "4", "name": "m1.large", "os-flavor-access:is_public": true, "disk": 80, "swap": 0, "ram": 8192, "vcpus": 4}} {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:13:43.883746 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.requestlog [None req-9f854b36-090e-4ff1-95f8-5d37e5bcc49a admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.106524 Jun 22 10:13:43.884724 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: [pid: 103157|app: 0|req: 15/31] 10.222.0.66 () {64 vars in 1282 bytes} [Wed Jun 22 10:13:43 2022] POST /compute/v2.1/flavors => generated 405 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 10:13:43.902337 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-734ddc60-7cf6-4002-8374-ce6e793b497d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:13:43.932725 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.requestlog [None req-734ddc60-7cf6-4002-8374-ce6e793b497d admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034279 Jun 22 10:13:43.933764 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: [pid: 103158|app: 0|req: 17/32] 10.222.0.66 () {64 vars in 1332 bytes} [Wed Jun 22 10:13:43 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:13:46.192810 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-9f854b36-090e-4ff1-95f8-5d37e5bcc49a admin admin] Calling method '>' {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:13:46.194447 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.requestlog [None req-9f854b36-090e-4ff1-95f8-5d37e5bcc49a admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002482 Jun 22 10:13:46.195467 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: [pid: 103157|app: 0|req: 16/33] 10.222.0.66 () {54 vars in 930 bytes} [Wed Jun 22 10:13:46 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:13:46.282388 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-4da3a4a9-80d5-4e17-916f-72ce30b31c81 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 160, "id": "5", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 8, "ram": 16384, "name": "m1.xlarge"}} {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:13:46.306880 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.requestlog [None req-4da3a4a9-80d5-4e17-916f-72ce30b31c81 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.100957 Jun 22 10:13:46.307783 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: [pid: 103158|app: 0|req: 18/34] 10.222.0.66 () {64 vars in 1282 bytes} [Wed Jun 22 10:13:46 2022] POST /compute/v2.1/flavors => generated 408 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 22 10:13:46.329545 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-ff33af39-2875-43bc-bfba-d500f6016afb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:13:46.360308 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.requestlog [None req-ff33af39-2875-43bc-bfba-d500f6016afb admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038090 Jun 22 10:13:46.361450 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: [pid: 103157|app: 0|req: 17/35] 10.222.0.66 () {64 vars in 1332 bytes} [Wed Jun 22 10:13:46 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:14:12.277135 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-4da3a4a9-80d5-4e17-916f-72ce30b31c81 admin admin] Calling method '>' {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:14:12.279030 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.requestlog [None req-4da3a4a9-80d5-4e17-916f-72ce30b31c81 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002549 Jun 22 10:14:12.279763 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: [pid: 103158|app: 0|req: 19/36] 10.222.0.66 () {54 vars in 930 bytes} [Wed Jun 22 10:14:12 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:14:12.292413 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG dbcounter [-] [103157] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:14:12.353219 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-6628ab50-3440-4275-ac23-5df5317e985d admin admin] Calling method '>' {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:14:12.371574 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.requestlog [None req-6628ab50-3440-4275-ac23-5df5317e985d admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.084067 Jun 22 10:14:12.372151 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: [pid: 103157|app: 0|req: 18/37] 10.222.0.66 () {60 vars in 1291 bytes} [Wed Jun 22 10:14:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:14:13.337007 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-4da3a4a9-80d5-4e17-916f-72ce30b31c81 admin admin] Calling method '>' {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:14:13.338063 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.requestlog [None req-4da3a4a9-80d5-4e17-916f-72ce30b31c81 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Jun 22 10:14:13.338461 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: [pid: 103158|app: 0|req: 20/38] 10.222.0.66 () {56 vars in 1074 bytes} [Wed Jun 22 10:14:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:14:13.545479 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-2fb82594-1e8c-410c-8e08-01210d895dee admin admin] Calling method '>' {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:14:13.551985 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.wsgi [None req-2fb82594-1e8c-410c-8e08-01210d895dee admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 22 10:14:13.555458 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-2fb82594-1e8c-410c-8e08-01210d895dee admin admin] Request method failure captured: Jun 22 10:14:13.555458 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 22 10:14:13.555458 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: Accept: application/json Jun 22 10:14:13.555458 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: Accept-Encoding: gzip, deflate Jun 22 10:14:13.555458 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: Connection: keep-alive Jun 22 10:14:13.555458 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: Content-Length: 0 Jun 22 10:14:13.555458 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: Host: 10.222.0.66 Jun 22 10:14:13.555458 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: Openstack-Api-Version: compute 2.90 Jun 22 10:14:13.555458 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: Openstack-System-Scope: None Jun 22 10:14:13.555458 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: User-Agent: python-novaclient Jun 22 10:14:13.555458 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: X-Auth-Token: gAAAAABisut1K2twnooQCHU9wcA9fTJIr7Xh8C3y_beH6J2H_q8vS7h-YcWKurM5TdOFnb52Fe0mOK-h5JWOzZ6gYEag6p7hw0JkPZ48zEXGJkV8NXXDIrwoaPHgVW3vKnc-8Zk1X6KsqtBlE4HqV5ZYyBMTRmgA5lYbfq9NmSkp9YMh1ezFRyM Jun 22 10:14:13.555458 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: X-Domain-Id: None Jun 22 10:14:13.555458 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: X-Domain-Name: None Jun 22 10:14:13.555458 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: X-Identity-Status: Confirmed Jun 22 10:14:13.555458 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: X-Is-Admin-Project: True Jun 22 10:14:13.555458 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: X-Openstack-Nova-Api-Version: 2.90 Jun 22 10:14:13.555458 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: X-Project-Domain-Id: default Jun 22 10:14:13.555458 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: X-Project-Domain-Name: Default Jun 22 10:14:13.555458 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: X-Project-Id: 5250969aacd849649f4438fde7d1550d Jun 22 10:14:13.555458 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: X-Project-Name: admin Jun 22 10:14:13.555458 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: X-Role: member,admin,reader Jun 22 10:14:13.555458 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: X-Roles: member,admin,reader Jun 22 10:14:13.557839 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_5250969aacd849649f4438fde7d1550d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5250969aacd849649f4438fde7d1550d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/5250969aacd849649f4438fde7d1550d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5250969aacd849649f4438fde7d1550d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}] Jun 22 10:14:13.557839 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: X-Tenant: admin Jun 22 10:14:13.557839 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: X-Tenant-Id: 5250969aacd849649f4438fde7d1550d Jun 22 10:14:13.557839 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: X-Tenant-Name: admin Jun 22 10:14:13.557839 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: X-User: admin Jun 22 10:14:13.557839 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: X-User-Domain-Id: default Jun 22 10:14:13.557839 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: X-User-Domain-Name: Default Jun 22 10:14:13.557839 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: X-User-Id: 24f043f060e24197b7146fc46f2ee305 Jun 22 10:14:13.557839 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: X-User-Name: admin Jun 22 10:14:13.557839 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: method: > Jun 22 10:14:13.557839 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: exception: Flavor 42 could not be found. Jun 22 10:14:13.557839 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: action_args: {'id': '42'} Jun 22 10:14:13.557839 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:14:13.557839 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:14:13.559655 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 22 10:14:13.559655 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 22 10:14:13.559655 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 22 10:14:13.559655 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 22 10:14:13.559655 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 22 10:14:13.559655 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 22 10:14:13.559655 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 22 10:14:13.559655 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 22 10:14:13.559655 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 22 10:14:13.559655 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:14:13.559655 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 22 10:14:13.559655 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 22 10:14:13.559655 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 22 10:14:13.559655 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi Jun 22 10:14:13.559655 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:14:13.559655 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi Jun 22 10:14:13.559655 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:14:13.559655 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:14:13.559655 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:14:13.562078 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:14:13.562078 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:14:13.562078 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:14:13.562078 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:14:13.562078 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 22 10:14:13.562078 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:14:13.562078 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 22 10:14:13.562078 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi Jun 22 10:14:13.562078 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:14:13.562078 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi Jun 22 10:14:13.562078 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:14:13.562078 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:14:13.562078 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:14:13.562078 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:14:13.562078 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:14:13.562078 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 22 10:14:13.562078 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi Jun 22 10:14:13.562078 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-2fb82594-1e8c-410c-8e08-01210d895dee admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:14:13.564711 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.requestlog [None req-2fb82594-1e8c-410c-8e08-01210d895dee admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.077974 Jun 22 10:14:13.564711 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: [pid: 103157|app: 0|req: 19/39] 10.222.0.66 () {60 vars in 1190 bytes} [Wed Jun 22 10:14:13 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 22 10:14:13.573732 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-41e93298-1ba3-40b8-bc4e-c1dccad6ac69 admin admin] Calling method '>' {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:14:13.578962 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG dbcounter [-] [103158] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:14:13.618427 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.requestlog [None req-41e93298-1ba3-40b8-bc4e-c1dccad6ac69 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.051064 Jun 22 10:14:13.619419 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: [pid: 103158|app: 0|req: 21/40] 10.222.0.66 () {60 vars in 1210 bytes} [Wed Jun 22 10:14:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:14:13.630349 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-fbeaeede-5b25-4f5c-ab71-1f7f76fd74c1 admin admin] Calling method '>' {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:14:13.653829 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.requestlog [None req-fbeaeede-5b25-4f5c-ab71-1f7f76fd74c1 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027281 Jun 22 10:14:13.654716 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: [pid: 103157|app: 0|req: 20/41] 10.222.0.66 () {60 vars in 1210 bytes} [Wed Jun 22 10:14:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:14:13.665616 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-6d1b8557-1203-4f99-8da3-33430771db70 admin admin] Calling method '>' {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:14:13.672704 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.wsgi [None req-6d1b8557-1203-4f99-8da3-33430771db70 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 22 10:14:13.676328 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-6d1b8557-1203-4f99-8da3-33430771db70 admin admin] Request method failure captured: Jun 22 10:14:13.676328 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 22 10:14:13.676328 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: Accept: application/json Jun 22 10:14:13.676328 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: Accept-Encoding: gzip, deflate Jun 22 10:14:13.676328 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: Connection: keep-alive Jun 22 10:14:13.676328 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: Content-Length: 0 Jun 22 10:14:13.676328 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: Host: 10.222.0.66 Jun 22 10:14:13.676328 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: Openstack-Api-Version: compute 2.90 Jun 22 10:14:13.676328 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: Openstack-System-Scope: None Jun 22 10:14:13.676328 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: User-Agent: python-novaclient Jun 22 10:14:13.676328 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: X-Auth-Token: gAAAAABisut1K2twnooQCHU9wcA9fTJIr7Xh8C3y_beH6J2H_q8vS7h-YcWKurM5TdOFnb52Fe0mOK-h5JWOzZ6gYEag6p7hw0JkPZ48zEXGJkV8NXXDIrwoaPHgVW3vKnc-8Zk1X6KsqtBlE4HqV5ZYyBMTRmgA5lYbfq9NmSkp9YMh1ezFRyM Jun 22 10:14:13.676328 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: X-Domain-Id: None Jun 22 10:14:13.676328 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: X-Domain-Name: None Jun 22 10:14:13.676328 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: X-Identity-Status: Confirmed Jun 22 10:14:13.676328 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: X-Is-Admin-Project: True Jun 22 10:14:13.676328 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: X-Openstack-Nova-Api-Version: 2.90 Jun 22 10:14:13.676328 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: X-Project-Domain-Id: default Jun 22 10:14:13.676328 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: X-Project-Domain-Name: Default Jun 22 10:14:13.676328 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: X-Project-Id: 5250969aacd849649f4438fde7d1550d Jun 22 10:14:13.676328 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: X-Project-Name: admin Jun 22 10:14:13.676328 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: X-Role: member,admin,reader Jun 22 10:14:13.676328 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: X-Roles: member,admin,reader Jun 22 10:14:13.678717 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_5250969aacd849649f4438fde7d1550d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5250969aacd849649f4438fde7d1550d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/5250969aacd849649f4438fde7d1550d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5250969aacd849649f4438fde7d1550d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}] Jun 22 10:14:13.678717 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: X-Tenant: admin Jun 22 10:14:13.678717 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: X-Tenant-Id: 5250969aacd849649f4438fde7d1550d Jun 22 10:14:13.678717 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: X-Tenant-Name: admin Jun 22 10:14:13.678717 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: X-User: admin Jun 22 10:14:13.678717 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: X-User-Domain-Id: default Jun 22 10:14:13.678717 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: X-User-Domain-Name: Default Jun 22 10:14:13.678717 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: X-User-Id: 24f043f060e24197b7146fc46f2ee305 Jun 22 10:14:13.678717 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: X-User-Name: admin Jun 22 10:14:13.678717 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: method: > Jun 22 10:14:13.678717 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: exception: Flavor 42 could not be found. Jun 22 10:14:13.678717 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: action_args: {'id': '42'} Jun 22 10:14:13.678717 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:14:13.678717 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:14:13.680153 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 22 10:14:13.680153 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 22 10:14:13.680153 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 22 10:14:13.680153 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 22 10:14:13.680153 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 22 10:14:13.680153 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 22 10:14:13.680153 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 22 10:14:13.680153 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 22 10:14:13.680153 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 22 10:14:13.680153 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:14:13.680153 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 22 10:14:13.680153 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 22 10:14:13.680153 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 22 10:14:13.680153 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi Jun 22 10:14:13.680153 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:14:13.680153 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi Jun 22 10:14:13.680153 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:14:13.680153 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:14:13.680153 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:14:13.682415 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:14:13.682415 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:14:13.682415 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:14:13.682415 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:14:13.682415 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 22 10:14:13.682415 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:14:13.682415 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 22 10:14:13.682415 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi Jun 22 10:14:13.682415 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:14:13.682415 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi Jun 22 10:14:13.682415 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:14:13.682415 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:14:13.682415 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:14:13.682415 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:14:13.682415 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:14:13.682415 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 22 10:14:13.682415 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi Jun 22 10:14:13.682415 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-6d1b8557-1203-4f99-8da3-33430771db70 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103158) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:14:13.684582 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.requestlog [None req-6d1b8557-1203-4f99-8da3-33430771db70 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016692 Jun 22 10:14:13.684582 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: [pid: 103158|app: 0|req: 22/42] 10.222.0.66 () {60 vars in 1190 bytes} [Wed Jun 22 10:14:13 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 22 10:14:14.549025 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-fbeaeede-5b25-4f5c-ab71-1f7f76fd74c1 admin admin] Calling method '>' {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:14:14.549954 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.requestlog [None req-fbeaeede-5b25-4f5c-ab71-1f7f76fd74c1 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001543 Jun 22 10:14:14.550343 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: [pid: 103157|app: 0|req: 21/43] 10.222.0.66 () {56 vars in 1074 bytes} [Wed Jun 22 10:14:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:14:14.763682 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-135f5bf3-87e5-40bc-9352-75e9f17ab54a admin admin] Calling method '>' {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:14:14.770274 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.wsgi [None req-135f5bf3-87e5-40bc-9352-75e9f17ab54a admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 22 10:14:14.771918 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-135f5bf3-87e5-40bc-9352-75e9f17ab54a admin admin] Request method failure captured: Jun 22 10:14:14.771918 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 22 10:14:14.771918 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: Accept: application/json Jun 22 10:14:14.771918 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: Accept-Encoding: gzip, deflate Jun 22 10:14:14.771918 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: Connection: keep-alive Jun 22 10:14:14.771918 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: Content-Length: 0 Jun 22 10:14:14.771918 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: Host: 10.222.0.66 Jun 22 10:14:14.771918 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: Openstack-Api-Version: compute 2.90 Jun 22 10:14:14.771918 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: Openstack-System-Scope: None Jun 22 10:14:14.771918 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: User-Agent: python-novaclient Jun 22 10:14:14.771918 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: X-Auth-Token: gAAAAABisut24XdJtThlFHc3hIcDEh7uQaMYBRy7_D1JRmtThCPkfCktCxvDx5V8XJmpC_v90rpqrZB-sPHrwfvYrzLXEzDdv66G95iHI2VOHKRFixprky9w03JCTJu6wRaiHC7MJNzdnkwBC5aHZx6EvvDrffcAquLBsuUVDafKLqvdSNi1MbY Jun 22 10:14:14.771918 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: X-Domain-Id: None Jun 22 10:14:14.771918 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: X-Domain-Name: None Jun 22 10:14:14.771918 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: X-Identity-Status: Confirmed Jun 22 10:14:14.771918 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: X-Is-Admin-Project: True Jun 22 10:14:14.771918 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: X-Openstack-Nova-Api-Version: 2.90 Jun 22 10:14:14.771918 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: X-Project-Domain-Id: default Jun 22 10:14:14.771918 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: X-Project-Domain-Name: Default Jun 22 10:14:14.771918 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: X-Project-Id: 5250969aacd849649f4438fde7d1550d Jun 22 10:14:14.771918 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: X-Project-Name: admin Jun 22 10:14:14.771918 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: X-Role: member,admin,reader Jun 22 10:14:14.771918 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: X-Roles: member,admin,reader Jun 22 10:14:14.773758 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_5250969aacd849649f4438fde7d1550d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5250969aacd849649f4438fde7d1550d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/5250969aacd849649f4438fde7d1550d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5250969aacd849649f4438fde7d1550d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}] Jun 22 10:14:14.773758 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: X-Tenant: admin Jun 22 10:14:14.773758 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: X-Tenant-Id: 5250969aacd849649f4438fde7d1550d Jun 22 10:14:14.773758 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: X-Tenant-Name: admin Jun 22 10:14:14.773758 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: X-User: admin Jun 22 10:14:14.773758 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: X-User-Domain-Id: default Jun 22 10:14:14.773758 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: X-User-Domain-Name: Default Jun 22 10:14:14.773758 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: X-User-Id: 24f043f060e24197b7146fc46f2ee305 Jun 22 10:14:14.773758 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: X-User-Name: admin Jun 22 10:14:14.773758 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: method: > Jun 22 10:14:14.773758 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: exception: Flavor 84 could not be found. Jun 22 10:14:14.773758 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: action_args: {'id': '84'} Jun 22 10:14:14.773758 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:14:14.773758 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:14:14.775328 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 22 10:14:14.775328 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 22 10:14:14.775328 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 22 10:14:14.775328 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 22 10:14:14.775328 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 22 10:14:14.775328 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 22 10:14:14.775328 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 22 10:14:14.775328 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 22 10:14:14.775328 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 22 10:14:14.775328 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:14:14.775328 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 22 10:14:14.775328 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 22 10:14:14.775328 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 22 10:14:14.775328 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi Jun 22 10:14:14.775328 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:14:14.775328 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi Jun 22 10:14:14.775328 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:14:14.775328 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:14:14.775328 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:14:14.777248 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:14:14.777248 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:14:14.777248 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:14:14.777248 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:14:14.777248 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 22 10:14:14.777248 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:14:14.777248 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 22 10:14:14.777248 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi Jun 22 10:14:14.777248 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:14:14.777248 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi Jun 22 10:14:14.777248 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:14:14.777248 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:14:14.777248 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:14:14.777248 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:14:14.777248 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:14:14.777248 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 22 10:14:14.777248 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi Jun 22 10:14:14.777248 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-135f5bf3-87e5-40bc-9352-75e9f17ab54a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103158) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:14:14.779096 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.requestlog [None req-135f5bf3-87e5-40bc-9352-75e9f17ab54a admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.083372 Jun 22 10:14:14.779096 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: [pid: 103158|app: 0|req: 23/44] 10.222.0.66 () {60 vars in 1190 bytes} [Wed Jun 22 10:14:14 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 22 10:14:14.784495 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-3647b32c-9434-42be-9d4a-7266f391beb0 admin admin] Calling method '>' {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:14:14.799589 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.requestlog [None req-3647b32c-9434-42be-9d4a-7266f391beb0 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019287 Jun 22 10:14:14.800056 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: [pid: 103157|app: 0|req: 22/45] 10.222.0.66 () {60 vars in 1210 bytes} [Wed Jun 22 10:14:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:14:14.810736 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-6db46db7-7044-474b-8d6e-c33e6c7b2d59 admin admin] Calling method '>' {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:14:14.827043 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.requestlog [None req-6db46db7-7044-474b-8d6e-c33e6c7b2d59 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019968 Jun 22 10:14:14.827629 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: [pid: 103158|app: 0|req: 24/46] 10.222.0.66 () {60 vars in 1210 bytes} [Wed Jun 22 10:14:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:14:14.838006 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-b80abcca-b7d3-4bea-9c95-72080fadd603 admin admin] Calling method '>' {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:14:14.843933 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.wsgi [None req-b80abcca-b7d3-4bea-9c95-72080fadd603 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 22 10:14:14.845500 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-b80abcca-b7d3-4bea-9c95-72080fadd603 admin admin] Request method failure captured: Jun 22 10:14:14.845500 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 22 10:14:14.845500 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: Accept: application/json Jun 22 10:14:14.845500 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: Accept-Encoding: gzip, deflate Jun 22 10:14:14.845500 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: Connection: keep-alive Jun 22 10:14:14.845500 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: Content-Length: 0 Jun 22 10:14:14.845500 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: Host: 10.222.0.66 Jun 22 10:14:14.845500 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: Openstack-Api-Version: compute 2.90 Jun 22 10:14:14.845500 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: Openstack-System-Scope: None Jun 22 10:14:14.845500 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: User-Agent: python-novaclient Jun 22 10:14:14.845500 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: X-Auth-Token: gAAAAABisut24XdJtThlFHc3hIcDEh7uQaMYBRy7_D1JRmtThCPkfCktCxvDx5V8XJmpC_v90rpqrZB-sPHrwfvYrzLXEzDdv66G95iHI2VOHKRFixprky9w03JCTJu6wRaiHC7MJNzdnkwBC5aHZx6EvvDrffcAquLBsuUVDafKLqvdSNi1MbY Jun 22 10:14:14.845500 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: X-Domain-Id: None Jun 22 10:14:14.845500 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: X-Domain-Name: None Jun 22 10:14:14.845500 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: X-Identity-Status: Confirmed Jun 22 10:14:14.845500 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: X-Is-Admin-Project: True Jun 22 10:14:14.845500 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: X-Openstack-Nova-Api-Version: 2.90 Jun 22 10:14:14.845500 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: X-Project-Domain-Id: default Jun 22 10:14:14.845500 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: X-Project-Domain-Name: Default Jun 22 10:14:14.845500 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: X-Project-Id: 5250969aacd849649f4438fde7d1550d Jun 22 10:14:14.845500 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: X-Project-Name: admin Jun 22 10:14:14.845500 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: X-Role: member,admin,reader Jun 22 10:14:14.845500 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: X-Roles: member,admin,reader Jun 22 10:14:14.847872 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_5250969aacd849649f4438fde7d1550d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5250969aacd849649f4438fde7d1550d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/5250969aacd849649f4438fde7d1550d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5250969aacd849649f4438fde7d1550d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}] Jun 22 10:14:14.847872 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: X-Tenant: admin Jun 22 10:14:14.847872 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: X-Tenant-Id: 5250969aacd849649f4438fde7d1550d Jun 22 10:14:14.847872 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: X-Tenant-Name: admin Jun 22 10:14:14.847872 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: X-User: admin Jun 22 10:14:14.847872 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: X-User-Domain-Id: default Jun 22 10:14:14.847872 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: X-User-Domain-Name: Default Jun 22 10:14:14.847872 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: X-User-Id: 24f043f060e24197b7146fc46f2ee305 Jun 22 10:14:14.847872 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: X-User-Name: admin Jun 22 10:14:14.847872 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: method: > Jun 22 10:14:14.847872 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: exception: Flavor 84 could not be found. Jun 22 10:14:14.847872 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: action_args: {'id': '84'} Jun 22 10:14:14.847872 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:14:14.847872 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:14:14.848715 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 22 10:14:14.848715 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 22 10:14:14.848715 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 22 10:14:14.848715 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 22 10:14:14.848715 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 22 10:14:14.848715 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 22 10:14:14.848715 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 22 10:14:14.848715 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 22 10:14:14.848715 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 22 10:14:14.848715 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:14:14.848715 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 22 10:14:14.848715 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 22 10:14:14.848715 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 22 10:14:14.848715 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi Jun 22 10:14:14.848715 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:14:14.848715 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi Jun 22 10:14:14.848715 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:14:14.848715 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:14:14.848715 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:14:14.849881 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:14:14.849881 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:14:14.849881 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:14:14.849881 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:14:14.849881 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 22 10:14:14.849881 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:14:14.849881 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 22 10:14:14.849881 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi Jun 22 10:14:14.849881 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:14:14.849881 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi Jun 22 10:14:14.849881 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:14:14.849881 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:14:14.849881 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:14:14.849881 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:14:14.849881 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:14:14.849881 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 22 10:14:14.849881 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi Jun 22 10:14:14.849881 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-b80abcca-b7d3-4bea-9c95-72080fadd603 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:14:14.851012 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.requestlog [None req-b80abcca-b7d3-4bea-9c95-72080fadd603 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012729 Jun 22 10:14:14.851012 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: [pid: 103157|app: 0|req: 23/47] 10.222.0.66 () {60 vars in 1190 bytes} [Wed Jun 22 10:14:14 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 22 10:14:15.721300 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-6db46db7-7044-474b-8d6e-c33e6c7b2d59 admin admin] Calling method '>' {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:14:15.722540 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.requestlog [None req-6db46db7-7044-474b-8d6e-c33e6c7b2d59 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001703 Jun 22 10:14:15.722957 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: [pid: 103158|app: 0|req: 25/48] 10.222.0.66 () {56 vars in 1074 bytes} [Wed Jun 22 10:14:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:14:16.059859 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-86d2870e-42dc-4ba8-b969-67e5aba5cae7 admin admin] Calling method '>' {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:14:16.066781 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.wsgi [None req-86d2870e-42dc-4ba8-b969-67e5aba5cae7 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 22 10:14:16.068360 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-86d2870e-42dc-4ba8-b969-67e5aba5cae7 admin admin] Request method failure captured: Jun 22 10:14:16.068360 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 22 10:14:16.068360 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: Accept: application/json Jun 22 10:14:16.068360 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: Accept-Encoding: gzip, deflate Jun 22 10:14:16.068360 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: Connection: keep-alive Jun 22 10:14:16.068360 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: Content-Length: 0 Jun 22 10:14:16.068360 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: Host: 10.222.0.66 Jun 22 10:14:16.068360 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: Openstack-Api-Version: compute 2.90 Jun 22 10:14:16.068360 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: Openstack-System-Scope: None Jun 22 10:14:16.068360 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: User-Agent: python-novaclient Jun 22 10:14:16.068360 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: X-Auth-Token: gAAAAABisut3u17PwfbYrBwJmD-nr9jwQeQpURiZMW0AeZuoTnziw1qIdFsU8fXrCFw-Jc1KCJazuH-Lcc2436VvcKao-RZMoZktlzMHb9-XMw91XkODMwvGVJvlDBAXWRPURt1H9E7SzrDODtR1RlvOf1bRlQ6Umw4zQ_1GlUewqK6Pm2L7Ipw Jun 22 10:14:16.068360 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: X-Domain-Id: None Jun 22 10:14:16.068360 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: X-Domain-Name: None Jun 22 10:14:16.068360 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: X-Identity-Status: Confirmed Jun 22 10:14:16.068360 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: X-Is-Admin-Project: True Jun 22 10:14:16.068360 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: X-Openstack-Nova-Api-Version: 2.90 Jun 22 10:14:16.068360 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: X-Project-Domain-Id: default Jun 22 10:14:16.068360 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: X-Project-Domain-Name: Default Jun 22 10:14:16.068360 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: X-Project-Id: 5250969aacd849649f4438fde7d1550d Jun 22 10:14:16.068360 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: X-Project-Name: admin Jun 22 10:14:16.068360 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: X-Role: member,admin,reader Jun 22 10:14:16.068360 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: X-Roles: member,admin,reader Jun 22 10:14:16.070971 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_5250969aacd849649f4438fde7d1550d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5250969aacd849649f4438fde7d1550d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/5250969aacd849649f4438fde7d1550d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5250969aacd849649f4438fde7d1550d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}] Jun 22 10:14:16.070971 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: X-Tenant: admin Jun 22 10:14:16.070971 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: X-Tenant-Id: 5250969aacd849649f4438fde7d1550d Jun 22 10:14:16.070971 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: X-Tenant-Name: admin Jun 22 10:14:16.070971 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: X-User: admin Jun 22 10:14:16.070971 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: X-User-Domain-Id: default Jun 22 10:14:16.070971 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: X-User-Domain-Name: Default Jun 22 10:14:16.070971 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: X-User-Id: 24f043f060e24197b7146fc46f2ee305 Jun 22 10:14:16.070971 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: X-User-Name: admin Jun 22 10:14:16.070971 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: method: > Jun 22 10:14:16.070971 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: exception: Flavor 451 could not be found. Jun 22 10:14:16.070971 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: action_args: {'id': '451'} Jun 22 10:14:16.070971 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:14:16.070971 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:14:16.072481 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 22 10:14:16.072481 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 22 10:14:16.072481 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 22 10:14:16.072481 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 22 10:14:16.072481 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 22 10:14:16.072481 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 22 10:14:16.072481 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 22 10:14:16.072481 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 22 10:14:16.072481 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 22 10:14:16.072481 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:14:16.072481 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 22 10:14:16.072481 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 22 10:14:16.072481 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 22 10:14:16.072481 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi Jun 22 10:14:16.072481 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:14:16.072481 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi Jun 22 10:14:16.072481 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:14:16.072481 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:14:16.072481 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:14:16.074658 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:14:16.074658 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:14:16.074658 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:14:16.074658 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:14:16.074658 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 22 10:14:16.074658 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:14:16.074658 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 22 10:14:16.074658 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi Jun 22 10:14:16.074658 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:14:16.074658 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi Jun 22 10:14:16.074658 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:14:16.074658 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:14:16.074658 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:14:16.074658 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:14:16.074658 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:14:16.074658 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 22 10:14:16.074658 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: ERROR nova.api.openstack.wsgi Jun 22 10:14:16.074658 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-86d2870e-42dc-4ba8-b969-67e5aba5cae7 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103157) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:14:16.076690 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.requestlog [None req-86d2870e-42dc-4ba8-b969-67e5aba5cae7 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.094072 Jun 22 10:14:16.076690 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: [pid: 103157|app: 0|req: 24/49] 10.222.0.66 () {60 vars in 1193 bytes} [Wed Jun 22 10:14:15 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 22 10:14:16.081649 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-56267919-1748-4371-bfd8-72c084f3de4e admin admin] Calling method '>' {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:14:16.096529 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.requestlog [None req-56267919-1748-4371-bfd8-72c084f3de4e admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018425 Jun 22 10:14:16.097180 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: [pid: 103158|app: 0|req: 26/50] 10.222.0.66 () {60 vars in 1210 bytes} [Wed Jun 22 10:14:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:14:16.108624 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-1f78f720-0147-4f10-8215-416aef1ef6d9 admin admin] Calling method '>' {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:14:16.124365 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.requestlog [None req-1f78f720-0147-4f10-8215-416aef1ef6d9 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020255 Jun 22 10:14:16.124932 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: [pid: 103157|app: 0|req: 25/51] 10.222.0.66 () {60 vars in 1210 bytes} [Wed Jun 22 10:14:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:14:16.135377 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-2c8e1c11-3be9-4466-bfa4-66bcae638853 admin admin] Calling method '>' {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:14:16.141351 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.wsgi [None req-2c8e1c11-3be9-4466-bfa4-66bcae638853 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 22 10:14:16.142998 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-2c8e1c11-3be9-4466-bfa4-66bcae638853 admin admin] Request method failure captured: Jun 22 10:14:16.142998 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 22 10:14:16.142998 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: Accept: application/json Jun 22 10:14:16.142998 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: Accept-Encoding: gzip, deflate Jun 22 10:14:16.142998 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: Connection: keep-alive Jun 22 10:14:16.142998 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: Content-Length: 0 Jun 22 10:14:16.142998 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: Host: 10.222.0.66 Jun 22 10:14:16.142998 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: Openstack-Api-Version: compute 2.90 Jun 22 10:14:16.142998 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: Openstack-System-Scope: None Jun 22 10:14:16.142998 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: User-Agent: python-novaclient Jun 22 10:14:16.142998 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: X-Auth-Token: gAAAAABisut3u17PwfbYrBwJmD-nr9jwQeQpURiZMW0AeZuoTnziw1qIdFsU8fXrCFw-Jc1KCJazuH-Lcc2436VvcKao-RZMoZktlzMHb9-XMw91XkODMwvGVJvlDBAXWRPURt1H9E7SzrDODtR1RlvOf1bRlQ6Umw4zQ_1GlUewqK6Pm2L7Ipw Jun 22 10:14:16.142998 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: X-Domain-Id: None Jun 22 10:14:16.142998 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: X-Domain-Name: None Jun 22 10:14:16.142998 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: X-Identity-Status: Confirmed Jun 22 10:14:16.142998 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: X-Is-Admin-Project: True Jun 22 10:14:16.142998 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: X-Openstack-Nova-Api-Version: 2.90 Jun 22 10:14:16.142998 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: X-Project-Domain-Id: default Jun 22 10:14:16.142998 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: X-Project-Domain-Name: Default Jun 22 10:14:16.142998 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: X-Project-Id: 5250969aacd849649f4438fde7d1550d Jun 22 10:14:16.142998 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: X-Project-Name: admin Jun 22 10:14:16.142998 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: X-Role: member,admin,reader Jun 22 10:14:16.142998 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: X-Roles: member,admin,reader Jun 22 10:14:16.145454 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_5250969aacd849649f4438fde7d1550d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5250969aacd849649f4438fde7d1550d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/5250969aacd849649f4438fde7d1550d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5250969aacd849649f4438fde7d1550d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}] Jun 22 10:14:16.145454 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: X-Tenant: admin Jun 22 10:14:16.145454 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: X-Tenant-Id: 5250969aacd849649f4438fde7d1550d Jun 22 10:14:16.145454 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: X-Tenant-Name: admin Jun 22 10:14:16.145454 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: X-User: admin Jun 22 10:14:16.145454 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: X-User-Domain-Id: default Jun 22 10:14:16.145454 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: X-User-Domain-Name: Default Jun 22 10:14:16.145454 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: X-User-Id: 24f043f060e24197b7146fc46f2ee305 Jun 22 10:14:16.145454 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: X-User-Name: admin Jun 22 10:14:16.145454 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: method: > Jun 22 10:14:16.145454 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: exception: Flavor 451 could not be found. Jun 22 10:14:16.145454 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: action_args: {'id': '451'} Jun 22 10:14:16.145454 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:14:16.145454 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:14:16.147055 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 22 10:14:16.147055 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 22 10:14:16.147055 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 22 10:14:16.147055 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 22 10:14:16.147055 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 22 10:14:16.147055 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 22 10:14:16.147055 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 22 10:14:16.147055 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 22 10:14:16.147055 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 22 10:14:16.147055 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:14:16.147055 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 22 10:14:16.147055 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 22 10:14:16.147055 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 22 10:14:16.147055 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi Jun 22 10:14:16.147055 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:14:16.147055 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi Jun 22 10:14:16.147055 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:14:16.147055 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:14:16.147055 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:14:16.149347 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:14:16.149347 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:14:16.149347 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:14:16.149347 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:14:16.149347 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 22 10:14:16.149347 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:14:16.149347 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 22 10:14:16.149347 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi Jun 22 10:14:16.149347 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:14:16.149347 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi Jun 22 10:14:16.149347 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:14:16.149347 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:14:16.149347 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:14:16.149347 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:14:16.149347 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:14:16.149347 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 22 10:14:16.149347 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: ERROR nova.api.openstack.wsgi Jun 22 10:14:16.149347 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-2c8e1c11-3be9-4466-bfa4-66bcae638853 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103158) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:14:16.151367 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.requestlog [None req-2c8e1c11-3be9-4466-bfa4-66bcae638853 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012703 Jun 22 10:14:16.151367 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: [pid: 103158|app: 0|req: 27/52] 10.222.0.66 () {60 vars in 1193 bytes} [Wed Jun 22 10:14:16 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 22 10:14:17.001627 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-1f78f720-0147-4f10-8215-416aef1ef6d9 admin admin] Calling method '>' {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:14:17.002819 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.requestlog [None req-1f78f720-0147-4f10-8215-416aef1ef6d9 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001545 Jun 22 10:14:17.003318 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: [pid: 103157|app: 0|req: 26/53] 10.222.0.66 () {56 vars in 1074 bytes} [Wed Jun 22 10:14:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:14:17.207619 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-bd22f741-e2a5-488c-9a23-1b26b9a0caaf admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:14:17.235619 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.requestlog [None req-bd22f741-e2a5-488c-9a23-1b26b9a0caaf admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.097199 Jun 22 10:14:17.236279 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: [pid: 103158|app: 0|req: 28/54] 10.222.0.66 () {64 vars in 1235 bytes} [Wed Jun 22 10:14:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 10:14:18.075168 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-1f78f720-0147-4f10-8215-416aef1ef6d9 admin admin] Calling method '>' {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:14:18.076185 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.requestlog [None req-1f78f720-0147-4f10-8215-416aef1ef6d9 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001562 Jun 22 10:14:18.076589 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: [pid: 103157|app: 0|req: 27/55] 10.222.0.66 () {56 vars in 1074 bytes} [Wed Jun 22 10:14:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:14:18.275836 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-516bc082-14cb-4725-b33e-c5c93271aeba admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:14:18.298755 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.requestlog [None req-516bc082-14cb-4725-b33e-c5c93271aeba admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.086667 Jun 22 10:14:18.299337 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: [pid: 103158|app: 0|req: 29/56] 10.222.0.66 () {64 vars in 1235 bytes} [Wed Jun 22 10:14:18 2022] POST /compute/v2.1/flavors => generated 405 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 10:14:19.142025 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-1f78f720-0147-4f10-8215-416aef1ef6d9 admin admin] Calling method '>' {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:14:19.143181 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.requestlog [None req-1f78f720-0147-4f10-8215-416aef1ef6d9 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001616 Jun 22 10:14:19.143567 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: [pid: 103157|app: 0|req: 28/57] 10.222.0.66 () {56 vars in 1074 bytes} [Wed Jun 22 10:14:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:14:19.346941 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-0b029c72-5afc-40a6-aded-c9223aa38269 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:14:19.368443 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.requestlog [None req-0b029c72-5afc-40a6-aded-c9223aa38269 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.080467 Jun 22 10:14:19.369149 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: [pid: 103158|app: 0|req: 30/58] 10.222.0.66 () {64 vars in 1235 bytes} [Wed Jun 22 10:14:19 2022] POST /compute/v2.1/flavors => generated 407 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 10:14:20.235577 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-1f78f720-0147-4f10-8215-416aef1ef6d9 admin admin] Calling method '>' {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:14:20.236711 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.requestlog [None req-1f78f720-0147-4f10-8215-416aef1ef6d9 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001594 Jun 22 10:14:20.237133 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: [pid: 103157|app: 0|req: 29/59] 10.222.0.66 () {56 vars in 1074 bytes} [Wed Jun 22 10:14:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:14:20.434231 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-f75ae172-e809-4562-a4ed-413602ba6f63 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:14:20.454787 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.requestlog [None req-f75ae172-e809-4562-a4ed-413602ba6f63 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.080547 Jun 22 10:14:20.455470 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: [pid: 103158|app: 0|req: 31/60] 10.222.0.66 () {64 vars in 1235 bytes} [Wed Jun 22 10:14:20 2022] POST /compute/v2.1/flavors => generated 409 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 10:14:21.309844 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-1f78f720-0147-4f10-8215-416aef1ef6d9 admin admin] Calling method '>' {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:14:21.311818 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.requestlog [None req-1f78f720-0147-4f10-8215-416aef1ef6d9 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002651 Jun 22 10:14:21.312571 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: [pid: 103157|app: 0|req: 30/61] 10.222.0.66 () {56 vars in 1074 bytes} [Wed Jun 22 10:14:21 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:14:21.636661 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-b01e1600-b0dd-418a-967c-05b9b913100b admin admin] Calling method '>' {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:14:21.658092 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.requestlog [None req-b01e1600-b0dd-418a-967c-05b9b913100b admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.078844 Jun 22 10:14:21.658684 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: [pid: 103158|app: 0|req: 32/62] 10.222.0.66 () {60 vars in 1202 bytes} [Wed Jun 22 10:14:21 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:15:10.437572 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-1f78f720-0147-4f10-8215-416aef1ef6d9 admin admin] Calling method '>' {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:15:10.438618 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.requestlog [None req-1f78f720-0147-4f10-8215-416aef1ef6d9 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Jun 22 10:15:10.438993 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: [pid: 103157|app: 0|req: 31/63] 10.222.0.66 () {54 vars in 930 bytes} [Wed Jun 22 10:15:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:15:10.449739 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG dbcounter [-] [103158] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:15:10.506098 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-5e482408-ba7f-4f68-97be-16c96d656e65 admin admin] Calling method '>' {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:15:10.526120 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.requestlog [None req-5e482408-ba7f-4f68-97be-16c96d656e65 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.080849 Jun 22 10:15:10.526720 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: [pid: 103158|app: 0|req: 33/64] 10.222.0.66 () {60 vars in 1291 bytes} [Wed Jun 22 10:15:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:15:10.551226 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-3aef7542-7fc2-417f-8dd3-1e507d8f10d0 admin admin] Calling method '>' {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:15:10.554787 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG dbcounter [-] [103157] Writing DB stats nova_api:SELECT=14 {{(pid=103157) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:15:10.560650 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.requestlog [None req-3aef7542-7fc2-417f-8dd3-1e507d8f10d0 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013416 Jun 22 10:15:10.561222 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: [pid: 103157|app: 0|req: 32/65] 10.222.0.66 () {60 vars in 1282 bytes} [Wed Jun 22 10:15:10 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:15:10.573263 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-f8dd5403-e7f0-45e9-ade5-1fce254b8d0c admin admin] Calling method '>' {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:15:10.581356 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.requestlog [None req-f8dd5403-e7f0-45e9-ade5-1fce254b8d0c admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011702 Jun 22 10:15:10.581911 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: [pid: 103158|app: 0|req: 34/66] 10.222.0.66 () {60 vars in 1285 bytes} [Wed Jun 22 10:15:10 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:15:10.594318 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-962a6477-2b73-4922-9ec2-bfa44014378c admin admin] Calling method '>' {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:15:10.602380 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.requestlog [None req-962a6477-2b73-4922-9ec2-bfa44014378c admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011940 Jun 22 10:15:10.603001 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: [pid: 103157|app: 0|req: 33/67] 10.222.0.66 () {60 vars in 1285 bytes} [Wed Jun 22 10:15:10 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:15:10.615212 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-4b4aa720-5a30-479f-b4db-ba1b77a19c7d admin admin] Calling method '>' {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:15:10.623515 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.requestlog [None req-4b4aa720-5a30-479f-b4db-ba1b77a19c7d admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011900 Jun 22 10:15:10.624079 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: [pid: 103158|app: 0|req: 35/68] 10.222.0.66 () {60 vars in 1282 bytes} [Wed Jun 22 10:15:10 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:18:28.531988 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-962a6477-2b73-4922-9ec2-bfa44014378c admin admin] Calling method '>' {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:28.533009 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.requestlog [None req-962a6477-2b73-4922-9ec2-bfa44014378c admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001773 Jun 22 10:18:28.533402 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: [pid: 103157|app: 0|req: 34/69] 10.222.0.66 () {56 vars in 1074 bytes} [Wed Jun 22 10:18:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:18:28.672634 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG dbcounter [-] [103158] Writing DB stats nova_api:SELECT=6 {{(pid=103158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:28.793339 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-6d2d84fc-3132-4ee7-aa24-e02bbe49b1f0 admin admin] Calling method '>' {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:28.794526 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 10:18:28.794526 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: warnings.warn(msg) Jun 22 10:18:28.795725 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG oslo_concurrency.lockutils [None req-6d2d84fc-3132-4ee7-aa24-e02bbe49b1f0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:28.796160 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG oslo_concurrency.lockutils [None req-6d2d84fc-3132-4ee7-aa24-e02bbe49b1f0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:28.796931 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG oslo_concurrency.lockutils [None req-6d2d84fc-3132-4ee7-aa24-e02bbe49b1f0 admin admin] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:28.797354 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG oslo_concurrency.lockutils [None req-6d2d84fc-3132-4ee7-aa24-e02bbe49b1f0 admin admin] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:28.830517 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.requestlog [None req-6d2d84fc-3132-4ee7-aa24-e02bbe49b1f0 admin admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.159281 Jun 22 10:18:28.831136 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: [pid: 103158|app: 0|req: 36/70] 10.222.0.66 () {60 vars in 1193 bytes} [Wed Jun 22 10:18:28 2022] GET /compute/v2.1/os-services => generated 791 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 10:18:29.666658 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-962a6477-2b73-4922-9ec2-bfa44014378c admin admin] Calling method '>' {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:29.667729 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.requestlog [None req-962a6477-2b73-4922-9ec2-bfa44014378c admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001573 Jun 22 10:18:29.668134 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: [pid: 103157|app: 0|req: 35/71] 10.222.0.66 () {56 vars in 1074 bytes} [Wed Jun 22 10:18:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:18:29.872439 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-f9a69649-1cd2-49ea-907b-66f91a9f6600 admin admin] Calling method '>' {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:29.873574 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 10:18:29.873574 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: warnings.warn(msg) Jun 22 10:18:29.874802 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG oslo_concurrency.lockutils [None req-f9a69649-1cd2-49ea-907b-66f91a9f6600 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:29.875241 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG oslo_concurrency.lockutils [None req-f9a69649-1cd2-49ea-907b-66f91a9f6600 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:29.876029 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG oslo_concurrency.lockutils [None req-f9a69649-1cd2-49ea-907b-66f91a9f6600 admin admin] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:29.876455 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG oslo_concurrency.lockutils [None req-f9a69649-1cd2-49ea-907b-66f91a9f6600 admin admin] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:29.895852 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.requestlog [None req-f9a69649-1cd2-49ea-907b-66f91a9f6600 admin admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.087184 Jun 22 10:18:29.896408 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: [pid: 103158|app: 0|req: 37/72] 10.222.0.66 () {60 vars in 1193 bytes} [Wed Jun 22 10:18:29 2022] GET /compute/v2.1/os-services => generated 791 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 10:18:41.169214 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-962a6477-2b73-4922-9ec2-bfa44014378c admin admin] Calling method '>' {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:41.170727 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.requestlog [None req-962a6477-2b73-4922-9ec2-bfa44014378c admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001950 Jun 22 10:18:41.171352 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: [pid: 103157|app: 0|req: 36/73] 10.222.0.66 () {56 vars in 1074 bytes} [Wed Jun 22 10:18:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:18:41.314929 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG dbcounter [-] [103158] Writing DB stats nova_cell0:SELECT=4 {{(pid=103158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:41.315850 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG dbcounter [-] [103158] Writing DB stats nova_cell1:SELECT=4 {{(pid=103158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:41.316677 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG dbcounter [-] [103158] Writing DB stats nova_api:SELECT=8 {{(pid=103158) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:18:41.378245 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-5ea462be-84dc-41fe-8829-176b79f72532 admin admin] Calling method '>' {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:41.379733 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 10:18:41.379733 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: warnings.warn(msg) Jun 22 10:18:41.381327 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG oslo_concurrency.lockutils [None req-5ea462be-84dc-41fe-8829-176b79f72532 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:41.381815 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG oslo_concurrency.lockutils [None req-5ea462be-84dc-41fe-8829-176b79f72532 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:41.382906 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG oslo_concurrency.lockutils [None req-5ea462be-84dc-41fe-8829-176b79f72532 admin admin] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:41.383370 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG oslo_concurrency.lockutils [None req-5ea462be-84dc-41fe-8829-176b79f72532 admin admin] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:41.411983 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.requestlog [None req-5ea462be-84dc-41fe-8829-176b79f72532 admin admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.101660 Jun 22 10:18:41.412732 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: [pid: 103158|app: 0|req: 38/74] 10.222.0.66 () {60 vars in 1193 bytes} [Wed Jun 22 10:18:41 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:18:42.292159 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: DEBUG nova.api.openstack.wsgi [None req-962a6477-2b73-4922-9ec2-bfa44014378c admin admin] Calling method '>' {{(pid=103157) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:42.293326 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: INFO nova.api.openstack.requestlog [None req-962a6477-2b73-4922-9ec2-bfa44014378c admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 Jun 22 10:18:42.293823 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: [pid: 103157|app: 0|req: 37/75] 10.222.0.66 () {56 vars in 1074 bytes} [Wed Jun 22 10:18:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:18:42.498485 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG nova.api.openstack.wsgi [None req-136b5b02-a750-4493-9cfa-90b4414e66ef admin admin] Calling method '>' {{(pid=103158) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:18:42.499904 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 22 10:18:42.499904 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: warnings.warn(msg) Jun 22 10:18:42.501429 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG oslo_concurrency.lockutils [None req-136b5b02-a750-4493-9cfa-90b4414e66ef admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:42.501866 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG oslo_concurrency.lockutils [None req-136b5b02-a750-4493-9cfa-90b4414e66ef admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:42.502742 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG oslo_concurrency.lockutils [None req-136b5b02-a750-4493-9cfa-90b4414e66ef admin admin] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:18:42.503159 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: DEBUG oslo_concurrency.lockutils [None req-136b5b02-a750-4493-9cfa-90b4414e66ef admin admin] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103158) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:18:42.524888 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: INFO nova.api.openstack.requestlog [None req-136b5b02-a750-4493-9cfa-90b4414e66ef admin admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.087866 Jun 22 10:18:42.525464 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: [pid: 103158|app: 0|req: 39/76] 10.222.0.66 () {60 vars in 1193 bytes} [Wed Jun 22 10:18:42 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:19:41.527111 dv-cinder-847132-1-iscsi devstack@n-api.service[103156]: Wed Jun 22 10:19:41 2022 - graceful shutdown triggered... Jun 22 10:19:41.526442 dv-cinder-847132-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 22 10:19:41.528102 dv-cinder-847132-1-iscsi devstack@n-api.service[103158]: Gracefully killing worker 2 (pid: 103158)... Jun 22 10:19:41.528460 dv-cinder-847132-1-iscsi devstack@n-api.service[103157]: Gracefully killing worker 1 (pid: 103157)... Jun 22 10:19:42.527691 dv-cinder-847132-1-iscsi devstack@n-api.service[103156]: worker 1 buried after 1 seconds Jun 22 10:19:42.527691 dv-cinder-847132-1-iscsi devstack@n-api.service[103156]: worker 2 buried after 1 seconds Jun 22 10:19:42.527691 dv-cinder-847132-1-iscsi devstack@n-api.service[103156]: goodbye to uWSGI. Jun 22 10:19:42.529537 dv-cinder-847132-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 22 10:19:42.530127 dv-cinder-847132-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 22 10:19:42.533382 dv-cinder-847132-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 22 10:19:42.544715 dv-cinder-847132-1-iscsi devstack@n-api.service[117659]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 22 10:19:42.547004 dv-cinder-847132-1-iscsi devstack@n-api.service[117659]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 22 10:19:42 2022] *** Jun 22 10:19:42.547004 dv-cinder-847132-1-iscsi devstack@n-api.service[117659]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 22 10:19:42.547004 dv-cinder-847132-1-iscsi devstack@n-api.service[117659]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 22 10:19:42.547004 dv-cinder-847132-1-iscsi devstack@n-api.service[117659]: nodename: dv-cinder-847132-1-iscsi Jun 22 10:19:42.547004 dv-cinder-847132-1-iscsi devstack@n-api.service[117659]: machine: x86_64 Jun 22 10:19:42.547004 dv-cinder-847132-1-iscsi devstack@n-api.service[117659]: clock source: unix Jun 22 10:19:42.547004 dv-cinder-847132-1-iscsi devstack@n-api.service[117659]: pcre jit disabled Jun 22 10:19:42.547004 dv-cinder-847132-1-iscsi devstack@n-api.service[117659]: detected number of CPU cores: 4 Jun 22 10:19:42.547004 dv-cinder-847132-1-iscsi devstack@n-api.service[117659]: current working directory: / Jun 22 10:19:42.547004 dv-cinder-847132-1-iscsi devstack@n-api.service[117659]: detected binary path: /usr/bin/uwsgi-core Jun 22 10:19:42.547779 dv-cinder-847132-1-iscsi devstack@n-api.service[117659]: your processes number limit is 47680 Jun 22 10:19:42.547779 dv-cinder-847132-1-iscsi devstack@n-api.service[117659]: your memory page size is 4096 bytes Jun 22 10:19:42.547779 dv-cinder-847132-1-iscsi devstack@n-api.service[117659]: detected max file descriptor number: 2048 Jun 22 10:19:42.547779 dv-cinder-847132-1-iscsi devstack@n-api.service[117659]: lock engine: pthread robust mutexes Jun 22 10:19:42.547779 dv-cinder-847132-1-iscsi devstack@n-api.service[117659]: thunder lock: enabled Jun 22 10:19:42.547779 dv-cinder-847132-1-iscsi devstack@n-api.service[117659]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 22 10:19:42.547779 dv-cinder-847132-1-iscsi devstack@n-api.service[117659]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 22 10:19:42.621024 dv-cinder-847132-1-iscsi devstack@n-api.service[117659]: Python main interpreter initialized at 0x56114b1379c0 Jun 22 10:19:42.621024 dv-cinder-847132-1-iscsi devstack@n-api.service[117659]: python threads support enabled Jun 22 10:19:42.621024 dv-cinder-847132-1-iscsi devstack@n-api.service[117659]: your server socket listen backlog is limited to 100 connections Jun 22 10:19:42.621024 dv-cinder-847132-1-iscsi devstack@n-api.service[117659]: your mercy for graceful operations on workers is 90 seconds Jun 22 10:19:42.621729 dv-cinder-847132-1-iscsi devstack@n-api.service[117659]: mapped 403077 bytes (393 KB) for 2 cores Jun 22 10:19:42.621729 dv-cinder-847132-1-iscsi devstack@n-api.service[117659]: *** Operational MODE: preforking *** Jun 22 10:19:42.622025 dv-cinder-847132-1-iscsi devstack@n-api.service[117659]: *** uWSGI is running in multiple interpreter mode *** Jun 22 10:19:42.622025 dv-cinder-847132-1-iscsi devstack@n-api.service[117659]: spawned uWSGI master process (pid: 117659) Jun 22 10:19:42.621990 dv-cinder-847132-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 22 10:19:42.625654 dv-cinder-847132-1-iscsi devstack@n-api.service[117659]: spawned uWSGI worker 1 (pid: 117679, cores: 1) Jun 22 10:19:42.625654 dv-cinder-847132-1-iscsi devstack@n-api.service[117659]: spawned uWSGI worker 2 (pid: 117680, cores: 1) Jun 22 10:19:42.626097 dv-cinder-847132-1-iscsi devstack@n-api.service[117659]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 22 10:19:43.301129 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 22 10:19:43.318848 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 22 10:19:44.509060 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 10:19:44.509060 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: from cryptography.utils import int_from_bytes Jun 22 10:19:44.509752 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 10:19:44.509752 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: from cryptography.utils import int_from_bytes Jun 22 10:19:44.540585 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 10:19:44.540585 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: from cryptography.utils import int_from_bytes Jun 22 10:19:44.541508 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 22 10:19:44.541508 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: from cryptography.utils import int_from_bytes Jun 22 10:19:46.981306 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 22 10:19:46.981306 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 22 10:19:46.981306 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 22 10:19:46.981306 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 22 10:19:46.981306 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 22 10:19:46.982561 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:46.982561 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:46.982561 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:46.982811 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:46.982933 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:46.983257 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:46.983619 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:46.983948 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:46.984263 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:46.984554 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:46.984880 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:46.985210 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847132-1-iscsi {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:46.985535 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:46.985877 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:46.986181 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:46.986631 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:46.986973 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:46.987326 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:46.987653 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:46.988219 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:46.989864 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:46.989864 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:46.989864 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:46.989864 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:46.990440 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:46.990440 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:46.990864 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:46.991008 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:46.991319 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:46.991645 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:46.992153 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847132-1-iscsi {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:46.992439 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:46.992774 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:46.993125 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:46.993521 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:46.993833 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:46.994178 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:46.994471 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:46.994865 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:46.995147 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:46.995508 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:46.995841 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:46.996158 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:46.996476 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:46.996799 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:46.997112 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:46.997423 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:46.997728 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:46.998048 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:46.998360 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:46.998658 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:46.998991 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:46.999372 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:46.999800 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.000045 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.000445 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.000635 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.000834 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.001167 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.001770 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.001770 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.002985 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.003442 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.003768 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.004044 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.004281 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.004630 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.004896 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.005183 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.005513 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.005827 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.006138 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.006594 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.66 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.006881 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.66 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.007265 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.007902 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.008475 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.009011 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.009608 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.010321 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.010321 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.010771 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.011149 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.011345 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.011869 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.012360 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.012662 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.012935 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.013251 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.013580 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.013897 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.014217 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.014567 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.014863 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.015187 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.015497 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.015801 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.016294 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.016758 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.017252 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.017585 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.017891 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.018207 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.018723 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.019226 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.019696 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.020171 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.020646 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.021133 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.021652 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.021962 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.022475 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.022833 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.023320 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.023635 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.023967 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.024284 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.024606 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.024932 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.025241 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.025563 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.025892 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.026206 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.026545 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.026896 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.027210 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.027501 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.027865 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.028129 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.028624 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.028934 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.029313 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.029598 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.029919 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.030240 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.030829 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.031498 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.031739 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.032012 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.032278 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.032562 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.033028 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.033283 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.033551 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.033823 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.034130 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.034475 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.034820 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.035144 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.035509 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.035795 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.036103 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.036434 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.036759 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.037084 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.037405 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.037733 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.038061 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.038398 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.038840 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.039083 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.039402 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.039757 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.040110 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.040402 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.041074 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.041074 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.041545 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.041798 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.042037 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.042340 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.042686 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.043260 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.043531 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.043827 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.044060 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.044339 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.044590 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.044875 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.046067 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.046067 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.046067 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.046863 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.046863 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.046863 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.047568 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.047568 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.048070 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.048070 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.048537 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.048537 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.049110 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.049343 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.049575 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.049795 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.050114 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.050431 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.050855 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.051452 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.051452 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.051937 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.052185 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.052463 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.052707 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.053004 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.053515 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.053813 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.054057 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.054296 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.054572 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.054879 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.055198 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.055512 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.055834 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.056177 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.056505 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.056821 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.057163 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.057504 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.057811 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.058202 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.058603 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.058934 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.059306 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.059544 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.059845 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.060157 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.060459 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.060767 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.061151 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.061420 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.062096 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.062096 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.062697 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.062697 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.063164 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.063409 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.063946 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.063946 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.064423 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.064423 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.064884 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.065128 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.065403 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.065731 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.066046 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.066373 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.066715 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.067034 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.067350 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.067679 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.068002 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.068327 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.068651 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.068968 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.069353 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.069590 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.069952 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.070233 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.070587 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.070919 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.071336 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.071574 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.072996 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.072996 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.072996 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.072996 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.074242 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.074242 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.074242 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.074242 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.075173 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.075173 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.075173 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.075820 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.075820 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.076299 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.076299 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.076771 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.077001 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.077267 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.077505 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.078091 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.078347 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.078651 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.078876 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.079105 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.079503 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.079750 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.079996 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.080313 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.080635 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.080959 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.081269 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.081642 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.081902 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.082170 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.082627 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.082867 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.083135 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.083532 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.083765 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.084331 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.084331 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.084791 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.085044 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.085310 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.085582 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.085897 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.086201 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.086573 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.086897 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.087220 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.087547 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.087885 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.088203 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.088533 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.088852 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.089197 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.089708 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.089948 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.090174 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.090456 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.090809 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.091128 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.091446 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.092061 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.092061 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.092550 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.092861 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.093215 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.093499 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.093878 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.095316 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.095316 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.095316 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.095316 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.096288 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.096288 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.096288 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.096929 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.096929 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.097404 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.097404 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.097857 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.098099 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.098345 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.098614 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.098876 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.099193 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.099514 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.099903 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.100133 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.100414 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.100724 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.101050 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.101356 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.101672 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.102044 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.102336 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.102621 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.102933 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.103227 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.103612 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.103871 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.104263 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.104513 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.105316 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.105316 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.105875 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.105875 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.106381 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.106381 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.106958 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.107246 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.107600 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.107600 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.108040 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.108276 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.108524 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.108833 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.109157 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.109461 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.109970 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.110209 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.110436 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.110727 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.111010 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.111315 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.111631 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.111947 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.112330 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.112678 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.112895 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.113152 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.113460 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.113854 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.114091 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.114449 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.114725 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.114972 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.115435 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.115669 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.115917 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.116189 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.116510 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.116819 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.117126 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.117440 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.117768 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.118089 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.118395 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.118717 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.119021 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.120699 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.120699 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.120699 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.120699 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.120699 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.121834 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.121834 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.121834 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.121834 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.122884 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.122884 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.122884 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.123521 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.123521 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.124115 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.124115 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.124720 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.124720 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.125201 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.125201 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.125923 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.125923 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.126340 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.126609 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.126862 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.127079 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.127340 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.127648 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.127975 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.128293 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.128612 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.128936 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.129268 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.129601 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.129917 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.130437 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.130714 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.130948 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.131173 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.131469 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.131786 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.132103 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.132421 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.132811 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.133045 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.133366 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.133710 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.134000 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.134452 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.134746 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.135121 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.135342 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.135595 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.136135 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.136377 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.136605 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.136979 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.137304 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.137623 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.137937 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.138263 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.138604 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.138931 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.139260 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.139571 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.139998 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.140624 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.140624 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.141106 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.141325 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.141566 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.141828 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.142158 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.142467 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.142804 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.143149 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.143427 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.143738 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.144064 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.144502 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.144813 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.145244 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.145540 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.146093 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.146311 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.146588 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.146836 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.147168 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.147480 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.147804 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.148120 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.148450 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.148781 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.149102 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.149426 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.149735 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.150063 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.150390 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.150985 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.151209 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.151469 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.151905 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.152141 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.152478 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.152812 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.153215 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.153433 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.153732 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.154044 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.154355 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.154822 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.155041 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.155509 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.155751 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.156010 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.156897 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.156897 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.157356 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.157576 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.157806 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.158126 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.158460 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.158817 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.159115 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.159443 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.159765 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.160075 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.160385 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.160695 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.161226 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.161475 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.161711 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.161968 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.162309 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.162644 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.162978 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.163359 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.163634 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.163960 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.164298 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.164611 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.165034 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.165279 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.165540 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.166056 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.166280 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.166673 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.167200 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.167200 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.167723 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.167723 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.168169 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.168396 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.168672 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.168993 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.169311 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.169639 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.169985 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.170289 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.170661 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.170996 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.171484 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.171847 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.172099 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.172331 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.172556 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.172883 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.173185 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.173563 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.173812 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.174139 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.174465 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.174875 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.175156 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.175550 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.175778 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.176309 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.176648 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.176977 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.177531 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.177783 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.178031 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.178258 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.178628 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.178883 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.179144 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.179472 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.179810 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.180143 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.180474 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.180817 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.181141 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.181645 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.181895 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.182133 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.182421 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.182767 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.183116 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.183438 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.183807 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.184125 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.184446 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.184765 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.185087 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.185407 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.185847 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.186085 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.186353 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.186798 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.187065 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.187314 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.187838 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.188078 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.188339 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.188574 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.189130 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.189450 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.189933 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.190186 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.190433 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.190795 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.191127 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.191463 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.191977 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.192224 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.192451 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.192682 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.192976 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.193306 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.193623 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.194033 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.194268 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.194898 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.195158 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.195521 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.195845 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.196329 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.196554 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.196813 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.197206 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.197428 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.197993 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.197993 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.198461 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.198830 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.199062 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.199354 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.199675 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.200000 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.200311 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.200630 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.200946 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.201284 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.201574 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.202078 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.202299 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.202624 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.202839 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.203117 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.203437 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.203739 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.204073 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.204435 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.204671 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.205417 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.205417 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.205868 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.205868 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.206541 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.206541 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.207027 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.207444 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.207444 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.208619 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.208619 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.208619 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.209345 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.209345 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.209345 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.210056 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.210295 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.210709 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.210955 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.211257 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.211572 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.211884 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.212398 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.212670 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.212917 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.213150 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.213414 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.213734 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.214048 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.214479 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.214842 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.215249 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.215562 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.215812 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.216075 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.216383 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.216816 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.217063 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.217345 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.217794 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.218089 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.218746 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.218999 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.219229 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.219515 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.219756 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.220045 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.220332 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.220674 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.220995 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.221308 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.221860 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.222193 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.222921 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.222921 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.223409 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.223649 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.223894 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.224168 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.224403 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.224799 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.225053 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.225463 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.225727 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.226009 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.226320 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.226683 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.227145 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.227388 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.227642 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.228077 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.228353 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.228910 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.229153 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.229409 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.229659 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.229962 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.230219 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.230567 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.230869 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.231173 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.231479 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.231788 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.232096 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.232402 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.232998 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.232998 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.233472 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.233744 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.233968 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.234213 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.234553 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.235201 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.235201 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.235831 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.235831 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.236339 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.236704 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.237005 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.237500 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.237500 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.237991 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.237991 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.238772 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.238772 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.239550 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.239550 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.241132 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.241507 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.241876 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.242228 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.242602 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.243210 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.243458 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.243682 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.243918 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.244240 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.244584 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.244909 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.245315 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.245629 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.246043 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.246294 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.246565 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.246882 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.247223 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.247707 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.247956 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.248195 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.248638 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.248881 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.249471 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.249746 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.250096 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.250416 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.250757 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.251070 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.251332 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 22 10:19:47.316616 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO dbcounter [None req-550d1f5f-1c7b-407b-9114-27b95c720dcc None None] Registered counter for database nova_api Jun 22 10:19:47.324326 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 22 10:19:47.325895 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 22 10:19:47.325895 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 22 10:19:47.325895 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 22 10:19:47.325895 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 22 10:19:47.326398 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.326398 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.327287 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.327287 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.327465 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.327626 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.327944 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.328259 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.328585 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.328843 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.329155 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.329484 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847132-1-iscsi {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.329797 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.330108 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.330410 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.330767 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.331072 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.331392 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.331695 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.332204 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.332511 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.332813 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.333209 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.333456 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.333766 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.334072 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.334394 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.334725 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.335053 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.335362 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.335764 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847132-1-iscsi {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.336080 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.336389 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.336700 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.337118 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.337428 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.337747 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.338050 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.338394 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.338715 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.338847 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_db.sqlalchemy.engines [None req-550d1f5f-1c7b-407b-9114-27b95c720dcc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117680) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 10:19:47.339055 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.339429 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.339749 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.340065 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.340366 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.340670 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.340978 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.341307 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.341603 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.341914 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.342155 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.342462 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.342807 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.343125 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.343443 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.343727 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.343934 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.344237 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.344555 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.344864 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.345167 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.345475 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.345776 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.346076 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.346378 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.346586 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writer thread running {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 10:19:47.346688 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.347054 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.347401 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.347614 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.347942 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.348244 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.348560 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.348967 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.66 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.349214 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.66 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.349534 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.349881 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.350195 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.350518 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.350834 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.351179 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.351459 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.351762 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.352068 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.352382 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.352717 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.353456 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.353456 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.353733 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.353871 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.354151 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.354455 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.354803 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.355167 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.355468 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.355773 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.356077 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.356381 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.356691 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.356995 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.357297 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.357601 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.357903 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.358204 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.358557 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.358860 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.359161 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.359467 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.359768 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.360068 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.360565 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.360872 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.361181 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.361504 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.361812 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.362116 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.362435 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.362764 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.363069 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.363384 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.363683 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.363989 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.364305 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.364609 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.364919 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.365221 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.365525 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.365833 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.366139 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.366441 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.366770 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.367163 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.367452 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.367781 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.368099 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.368505 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.368796 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.369122 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 22 10:19:47.369518 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.369895 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.370190 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.370575 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.370920 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.371250 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.371577 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.371894 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.372205 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.372527 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.372838 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.373147 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.373462 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.373774 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.374090 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.374418 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.374759 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.375088 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.375407 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.375716 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.376034 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.376359 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.376678 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.377188 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.377386 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.377702 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.377977 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.379018 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.379018 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.379018 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.379504 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.379504 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.379837 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.380160 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.380475 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.380790 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.381097 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.381407 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.381713 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.382020 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.382327 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.382688 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.384035 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.384035 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.384035 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.384035 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.384441 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.384533 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.384800 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.385109 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.385418 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.385721 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.386028 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.386360 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.387485 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.387485 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.387485 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.388190 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.388190 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.388409 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.388513 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.388829 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.389133 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.389441 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.389749 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.390056 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.390379 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.390715 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.391034 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.391344 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.391648 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.391954 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.392267 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.392577 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.392886 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.393194 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.393502 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.393829 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.394132 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.394442 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.394804 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.395138 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.395440 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.395761 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.396090 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.396403 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.396704 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.397013 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.397320 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.397621 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.397924 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.398232 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.398550 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.398855 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.399157 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.399458 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.399758 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.400086 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.400402 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.400705 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.401008 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.401316 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.401683 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.402132 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.402433 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.402861 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.403198 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.403513 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.403820 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.404135 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.404450 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.404762 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.405073 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.405381 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.405704 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.406013 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.406662 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.406900 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.context [None req-550d1f5f-1c7b-407b-9114-27b95c720dcc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),99dc5dbe-6aa5-4c21-a61e-113fd190a23f(cell1) {{(pid=117680) load_cells /opt/stack/nova/nova/context.py:464}} Jun 22 10:19:47.407039 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.407280 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.407586 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.407902 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.408208 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.408518 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.408861 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.409193 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.409506 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.409826 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.411023 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.411023 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.411023 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.411448 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.411605 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-550d1f5f-1c7b-407b-9114-27b95c720dcc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:47.411757 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.411757 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.412013 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.412263 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.412738 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.412893 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.413066 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-550d1f5f-1c7b-407b-9114-27b95c720dcc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:47.413200 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.413489 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.413783 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-550d1f5f-1c7b-407b-9114-27b95c720dcc None None] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:47.413907 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.414965 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.414965 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.414965 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.415468 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.415468 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.415784 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.415958 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-550d1f5f-1c7b-407b-9114-27b95c720dcc None None] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:47.416125 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.416306 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.416616 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.416927 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.417230 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.417567 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.417882 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.418188 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO dbcounter [None req-550d1f5f-1c7b-407b-9114-27b95c720dcc None None] Registered counter for database nova_cell0 Jun 22 10:19:47.418357 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.418602 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.418834 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.419136 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.419449 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.419758 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.420070 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.420379 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.420902 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.421093 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.421298 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.421617 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.421937 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.422255 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.423358 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.423542 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO dbcounter [None req-550d1f5f-1c7b-407b-9114-27b95c720dcc None None] Registered counter for database nova_cell1 Jun 22 10:19:47.423840 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.423840 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.423840 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.423840 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.424554 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.424554 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.424879 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.425061 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.425818 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.426187 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.426897 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.427257 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.433942 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.433942 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.433942 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.433942 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.433942 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.433942 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.433942 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.433942 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.436118 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.436118 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.436118 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.436118 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.436118 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.437016 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_db.sqlalchemy.engines [None req-550d1f5f-1c7b-407b-9114-27b95c720dcc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117680) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 10:19:47.437367 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.437367 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.437367 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.437367 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.437367 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.437367 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.437367 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.437367 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.439311 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.439311 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.440131 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_db.sqlalchemy.engines [None req-550d1f5f-1c7b-407b-9114-27b95c720dcc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117680) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 10:19:47.440494 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.440494 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.440494 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.440494 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.440494 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.440494 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.440494 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.440494 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.442309 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.442309 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.442309 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.442309 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.442309 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.442309 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.442309 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.442309 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.443637 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.443637 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.443637 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.443637 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.443637 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.443637 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.443637 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.443637 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.445354 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.445354 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.445354 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.445354 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.445354 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.446588 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writer thread running {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 10:19:47.446793 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.446793 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.446793 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.446793 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.447465 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writer thread running {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 10:19:47.447582 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.447582 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.447582 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.447582 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.447582 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.447582 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.447582 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.447582 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.448273 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.448273 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.448273 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.448676 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.448676 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.448977 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.449278 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.449592 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.449921 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.450252 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.450598 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.450918 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.451221 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.451539 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.451838 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.452142 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.452446 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.452759 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.453129 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.453404 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.453776 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.454946 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.454946 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.454946 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.457316 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.457316 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.457316 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.457316 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.457316 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.457316 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.457316 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.457316 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.457952 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.457952 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.458204 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.458296 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.458635 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.458945 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.460084 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.460412 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.460732 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.461073 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.461383 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.461700 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.462272 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.463290 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.463658 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.463976 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.464659 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.464984 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.465506 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.465677 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.465940 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.466462 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.470026 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.470026 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.470026 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.470026 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.470026 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.470026 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.470026 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.470026 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.470636 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.470636 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.470636 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.470636 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.470636 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.470636 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.471567 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.471567 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.471730 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.471948 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.472271 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.472586 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.472898 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.473212 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.473527 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.473836 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.474148 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.474472 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.474792 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.475104 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.475431 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.475742 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.476049 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.476360 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.476664 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.476974 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.477278 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.477722 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.478033 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.478345 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.478673 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.478983 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.479293 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.479612 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.479962 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.480265 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.480687 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.480998 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.481307 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.481616 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.481919 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.482224 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.482578 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.482907 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.483228 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.483533 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.483821 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.484143 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.484733 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.484858 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.485185 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.485497 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.485817 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.486227 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.486711 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.486868 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.487192 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.487511 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.487833 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.488137 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.488451 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.488760 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.489082 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.489405 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.489715 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.490030 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.490334 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.490700 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.491020 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.491333 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.491653 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.492072 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.492394 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.492705 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.493027 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.493360 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.493668 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.493973 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.494291 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.494681 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.494931 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.495253 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.495614 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.495928 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.497185 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.497185 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.497185 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.497185 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.497746 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.497746 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.498104 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.498396 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.498719 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.499037 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.499342 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.499662 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.499970 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.500275 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.500609 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.500878 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.501221 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.501534 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.501857 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.502185 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.502545 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.502924 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.507651 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.507651 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.507651 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.507651 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.507651 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.507651 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.507651 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.507651 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.509551 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.509551 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.509551 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.509551 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.509551 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.509551 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.509551 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.509551 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.511008 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.511008 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.511008 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.511008 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.511008 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.511008 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.511008 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.511008 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.512586 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.512586 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.512586 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.512586 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.512586 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.512586 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.512586 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.513842 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.513842 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.513842 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.513842 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.514929 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.514929 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.514929 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.514929 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.515703 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.515703 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.516051 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.516370 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.516682 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.516995 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.517301 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.517615 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.517970 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.518220 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.518561 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.518830 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.519148 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.519479 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.519799 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.520124 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.520456 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.520778 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.521091 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.521403 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.521714 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.522068 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.522376 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.522714 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.523026 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.523341 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.523653 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.523974 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.524287 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.524620 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.524950 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.525215 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.525526 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.525833 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.526146 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.526473 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.526889 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.527244 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.527531 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.527847 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.528229 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.528713 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.529026 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.529358 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.529686 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.530002 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.530826 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.530826 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.531609 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.531609 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.532083 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.532305 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.532548 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.532790 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.533111 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.533420 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.533730 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.534350 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.534730 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.535300 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.535655 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.535970 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.536294 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.536610 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.536926 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.537233 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.537559 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.537865 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.538167 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.538636 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.539074 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.539247 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.539401 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.539715 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.540003 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.540308 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.540617 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.540917 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.541240 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.541545 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.541855 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.542157 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.542546 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.542831 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.543140 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.543445 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.543752 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.544066 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.544366 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.544674 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.545046 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.545361 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.545591 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.545863 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.546217 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.546577 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.546871 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.547172 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.547492 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.547924 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.548159 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.548385 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.548762 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.549027 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.549347 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.549932 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.550260 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.550599 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.550949 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.551285 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.551588 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.551892 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.552194 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.552513 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.553044 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.553366 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.553654 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.553949 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.554263 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.554587 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.554909 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.555343 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.555744 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.555967 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.556188 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.556397 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.556725 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.557041 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.557397 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.557768 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.558167 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.558823 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.559341 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.559945 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.560376 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.560693 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.561009 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.561341 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.561678 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.561996 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.562302 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.562872 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.563240 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.563564 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.563888 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.564202 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.564523 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.564851 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.565171 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.565580 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.565926 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.566418 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.567075 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.567663 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.568310 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.569013 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.569383 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.569687 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.570011 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.570342 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.570776 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.571039 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.571287 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.571581 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.571880 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.572190 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.572476 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.572782 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.573089 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.573418 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.573721 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.574028 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.574330 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.574729 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.575038 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.575351 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.575672 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.575934 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.576239 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.576547 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.576846 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.577182 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.577512 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.577825 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.578146 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.578459 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.578805 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.579161 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.579431 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.579753 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.580080 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.580390 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.580720 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.581029 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.581339 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.581650 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.581960 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.582278 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.582599 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.582934 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.583261 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.583565 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.583905 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.584205 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.584528 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.584842 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.585157 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.585481 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.585818 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.586105 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.586577 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.586829 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.587070 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.587340 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.587661 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.587984 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.588307 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.588622 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.588936 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.589446 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.589821 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.590130 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.590480 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.590829 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.591165 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.591451 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.591767 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 22 10:19:47.592016 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 22 10:19:47.654455 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO dbcounter [None req-b00e6fc3-5891-46bc-b741-6e38542174b9 None None] Registered counter for database nova_api Jun 22 10:19:47.672946 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO dbcounter [None req-550d1f5f-1c7b-407b-9114-27b95c720dcc None None] Registered counter for database nova_cell0 Jun 22 10:19:47.678981 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_db.sqlalchemy.engines [None req-b00e6fc3-5891-46bc-b741-6e38542174b9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117679) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 10:19:47.683244 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_db.sqlalchemy.engines [None req-550d1f5f-1c7b-407b-9114-27b95c720dcc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117680) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 10:19:47.692094 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writer thread running {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 10:19:47.692358 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writer thread running {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 10:19:47.757872 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.context [None req-b00e6fc3-5891-46bc-b741-6e38542174b9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),99dc5dbe-6aa5-4c21-a61e-113fd190a23f(cell1) {{(pid=117679) load_cells /opt/stack/nova/nova/context.py:464}} Jun 22 10:19:47.762311 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b00e6fc3-5891-46bc-b741-6e38542174b9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:47.764040 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b00e6fc3-5891-46bc-b741-6e38542174b9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:47.764956 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b00e6fc3-5891-46bc-b741-6e38542174b9 None None] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:19:47.767058 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b00e6fc3-5891-46bc-b741-6e38542174b9 None None] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:19:47.769218 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO dbcounter [None req-b00e6fc3-5891-46bc-b741-6e38542174b9 None None] Registered counter for database nova_cell0 Jun 22 10:19:47.773571 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO dbcounter [None req-b00e6fc3-5891-46bc-b741-6e38542174b9 None None] Registered counter for database nova_cell1 Jun 22 10:19:47.784068 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_db.sqlalchemy.engines [None req-b00e6fc3-5891-46bc-b741-6e38542174b9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117679) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 10:19:47.785457 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_db.sqlalchemy.engines [None req-b00e6fc3-5891-46bc-b741-6e38542174b9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117679) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 10:19:47.795723 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writer thread running {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 10:19:47.797461 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writer thread running {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 10:19:47.957386 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO dbcounter [None req-b00e6fc3-5891-46bc-b741-6e38542174b9 None None] Registered counter for database nova_cell0 Jun 22 10:19:47.965043 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_db.sqlalchemy.engines [None req-b00e6fc3-5891-46bc-b741-6e38542174b9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117679) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 22 10:19:47.971803 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writer thread running {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 22 10:19:48.031920 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: WARNING keystonemiddleware.auth_token [None req-550d1f5f-1c7b-407b-9114-27b95c720dcc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 10:19:48.039513 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: WARNING keystonemiddleware.auth_token [None req-550d1f5f-1c7b-407b-9114-27b95c720dcc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 10:19:48.304827 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: WARNING keystonemiddleware.auth_token [None req-b00e6fc3-5891-46bc-b741-6e38542174b9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 10:19:48.312811 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: WARNING keystonemiddleware.auth_token [None req-b00e6fc3-5891-46bc-b741-6e38542174b9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 10:19:48.392606 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: WARNING keystonemiddleware.auth_token [None req-550d1f5f-1c7b-407b-9114-27b95c720dcc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 10:19:48.399194 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: WARNING keystonemiddleware.auth_token [None req-550d1f5f-1c7b-407b-9114-27b95c720dcc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 10:19:48.405210 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56114b1379c0 pid: 117680 (default app) Jun 22 10:19:48.659735 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: WARNING keystonemiddleware.auth_token [None req-b00e6fc3-5891-46bc-b741-6e38542174b9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 22 10:19:48.666038 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: WARNING keystonemiddleware.auth_token [None req-b00e6fc3-5891-46bc-b741-6e38542174b9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 22 10:19:48.671608 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56114b1379c0 pid: 117679 (default app) Jun 22 10:20:31.076734 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_api:SELECT=3 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:31.083460 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:SELECT=3 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:31.086055 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell0:SELECT=3 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:31.087105 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell0:SELECT=3 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:31.184347 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_api:SELECT=3 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:31.186258 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_cell1:SELECT=3 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:31.187539 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_cell0:SELECT=3 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:31.188790 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_cell0:SELECT=3 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:32.115032 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-9e2a5146-3c31-4f07-a0e4-5cc53395d1f9 tempest-VolumesGetTestJSON-1635429826 tempest-VolumesGetTestJSON-1635429826-project] Action: 'create', calling method: .version_select at 0x7f60dc011700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1657947788", "metadata": {"Type": "work"}}} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:20:32.224371 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-24024db2-104b-4b35-b9cf-3cff6be28763 tempest-VolumesNegativeTest-305655433 tempest-VolumesNegativeTest-305655433-project] Action: 'create', calling method: .version_select at 0x7f60dc00c790>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-832014698", "metadata": {"Type": "work"}}} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:20:32.241114 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-24024db2-104b-4b35-b9cf-3cff6be28763 tempest-VolumesNegativeTest-305655433 tempest-VolumesNegativeTest-305655433-project] Request method failure captured: Jun 22 10:20:32.241114 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 22 10:20:32.241114 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Accept: application/json Jun 22 10:20:32.241114 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Accept-Encoding: identity Jun 22 10:20:32.241114 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Connection: close Jun 22 10:20:32.241114 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Content-Length: 121 Jun 22 10:20:32.241114 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Content-Type: application/json Jun 22 10:20:32.241114 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Host: 10.222.0.66 Jun 22 10:20:32.241114 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Openstack-System-Scope: None Jun 22 10:20:32.241114 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: User-Agent: python-urllib3/1.26.9 Jun 22 10:20:32.241114 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Auth-Token: gAAAAABisuzujPnAR0zjYP7UmQJdwgY29_6z0BP9aP1B5FoFIMyoFPSWR8vRhj08ocC2yWv8YeYVu3gnpWUFE8WYSg24MpyuF5zNs_n29lB1bPFx2A7cpYR_-MNGLLeeLOymdNaIt07SRDv9ctlHIZAZCuLEBtbfGjX1fXzbJsnbrD3-p11O9Ks Jun 22 10:20:32.241114 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Domain-Id: None Jun 22 10:20:32.241114 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Domain-Name: None Jun 22 10:20:32.241114 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Identity-Status: Confirmed Jun 22 10:20:32.241114 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Is-Admin-Project: True Jun 22 10:20:32.241114 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Domain-Id: default Jun 22 10:20:32.241114 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Domain-Name: Default Jun 22 10:20:32.241114 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Id: 8b1b7d70b3b44138bd6f80d9b24ce476 Jun 22 10:20:32.241114 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Name: tempest-VolumesNegativeTest-305655433 Jun 22 10:20:32.241114 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Role: member,reader Jun 22 10:20:32.241114 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Roles: member,reader Jun 22 10:20:32.242723 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8b1b7d70b3b44138bd6f80d9b24ce476"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8b1b7d70b3b44138bd6f80d9b24ce476"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8b1b7d70b3b44138bd6f80d9b24ce476"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8b1b7d70b3b44138bd6f80d9b24ce476"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}] Jun 22 10:20:32.242723 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant: tempest-VolumesNegativeTest-305655433 Jun 22 10:20:32.242723 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant-Id: 8b1b7d70b3b44138bd6f80d9b24ce476 Jun 22 10:20:32.242723 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant-Name: tempest-VolumesNegativeTest-305655433 Jun 22 10:20:32.242723 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User: tempest-VolumesNegativeTest-305655433-project Jun 22 10:20:32.242723 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Domain-Id: default Jun 22 10:20:32.242723 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Domain-Name: Default Jun 22 10:20:32.242723 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Id: e6c1a85eee1549ebafcae52711e5d967 Jun 22 10:20:32.242723 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Name: tempest-VolumesNegativeTest-305655433-project Jun 22 10:20:32.242723 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Jun 22 10:20:32.242723 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-832014698", "metadata": {"Type": "work"}}} Jun 22 10:20:32.242723 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: method: Jun 22 10:20:32.242723 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 22 10:20:32.244064 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-832014698', 'metadata': {'Type': 'work'}}}} Jun 22 10:20:32.244064 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:20:32.244064 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:20:32.244064 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 22 10:20:32.244064 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 22 10:20:32.244064 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 22 10:20:32.244064 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise error Jun 22 10:20:32.244064 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 22 10:20:32.244064 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:20:32.244064 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 22 10:20:32.244064 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 22 10:20:32.244064 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:20:32.244064 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 22 10:20:32.244064 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi '#$%' Jun 22 10:20:32.244064 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:20:32.244064 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:20:32.244064 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:20:32.244064 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:20:32.244064 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:20:32.244064 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:20:32.244064 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:20:32.244064 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:20:32.245496 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 10:20:32.245496 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 10:20:32.245496 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:20:32.245496 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:20:32.245496 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 22 10:20:32.245496 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 22 10:20:32.245496 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 22 10:20:32.245496 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 22 10:20:32.245496 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 22 10:20:32.245496 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 22 10:20:32.245496 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 22 10:20:32.245496 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:20:32.245496 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:20:32.245496 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:20:32.245496 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:20:32.245496 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:20:32.245496 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:20:32.245496 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 22 10:20:32.245496 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 22 10:20:32.249122 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 22 10:20:32.249122 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:20:32.251152 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-24024db2-104b-4b35-b9cf-3cff6be28763 tempest-VolumesNegativeTest-305655433 tempest-VolumesNegativeTest-305655433-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:20:32.253397 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-24024db2-104b-4b35-b9cf-3cff6be28763 tempest-VolumesNegativeTest-305655433 tempest-VolumesNegativeTest-305655433-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.195607 Jun 22 10:20:32.254419 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 1/1] 10.222.0.66 () {60 vars in 1155 bytes} [Wed Jun 22 10:20:31 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1198 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 22 10:20:32.264930 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-16c8af8c-707c-40f4-ba04-3e7b4f3f0494 tempest-VolumesNegativeTest-305655433 tempest-VolumesNegativeTest-305655433-project] Action: 'create', calling method: .version_select at 0x7f60dbf93a60>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1849723962", "metadata": {"Type": "work"}}} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:20:32.276919 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-16c8af8c-707c-40f4-ba04-3e7b4f3f0494 tempest-VolumesNegativeTest-305655433 tempest-VolumesNegativeTest-305655433-project] Request method failure captured: Jun 22 10:20:32.276919 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 22 10:20:32.276919 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Accept: application/json Jun 22 10:20:32.276919 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Accept-Encoding: identity Jun 22 10:20:32.276919 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Connection: close Jun 22 10:20:32.276919 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Content-Length: 120 Jun 22 10:20:32.276919 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Content-Type: application/json Jun 22 10:20:32.276919 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Host: 10.222.0.66 Jun 22 10:20:32.276919 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Openstack-System-Scope: None Jun 22 10:20:32.276919 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: User-Agent: python-urllib3/1.26.9 Jun 22 10:20:32.276919 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Auth-Token: gAAAAABisuzujPnAR0zjYP7UmQJdwgY29_6z0BP9aP1B5FoFIMyoFPSWR8vRhj08ocC2yWv8YeYVu3gnpWUFE8WYSg24MpyuF5zNs_n29lB1bPFx2A7cpYR_-MNGLLeeLOymdNaIt07SRDv9ctlHIZAZCuLEBtbfGjX1fXzbJsnbrD3-p11O9Ks Jun 22 10:20:32.276919 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Domain-Id: None Jun 22 10:20:32.276919 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Domain-Name: None Jun 22 10:20:32.276919 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Identity-Status: Confirmed Jun 22 10:20:32.276919 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Is-Admin-Project: True Jun 22 10:20:32.276919 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Domain-Id: default Jun 22 10:20:32.276919 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Domain-Name: Default Jun 22 10:20:32.276919 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Id: 8b1b7d70b3b44138bd6f80d9b24ce476 Jun 22 10:20:32.276919 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Name: tempest-VolumesNegativeTest-305655433 Jun 22 10:20:32.276919 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Role: member,reader Jun 22 10:20:32.276919 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Roles: member,reader Jun 22 10:20:32.278853 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8b1b7d70b3b44138bd6f80d9b24ce476"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8b1b7d70b3b44138bd6f80d9b24ce476"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8b1b7d70b3b44138bd6f80d9b24ce476"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8b1b7d70b3b44138bd6f80d9b24ce476"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}] Jun 22 10:20:32.278853 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant: tempest-VolumesNegativeTest-305655433 Jun 22 10:20:32.278853 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant-Id: 8b1b7d70b3b44138bd6f80d9b24ce476 Jun 22 10:20:32.278853 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant-Name: tempest-VolumesNegativeTest-305655433 Jun 22 10:20:32.278853 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User: tempest-VolumesNegativeTest-305655433-project Jun 22 10:20:32.278853 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Domain-Id: default Jun 22 10:20:32.278853 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Domain-Name: Default Jun 22 10:20:32.278853 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Id: e6c1a85eee1549ebafcae52711e5d967 Jun 22 10:20:32.278853 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Name: tempest-VolumesNegativeTest-305655433-project Jun 22 10:20:32.278853 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Jun 22 10:20:32.278853 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1849723962", "metadata": {"Type": "work"}}} Jun 22 10:20:32.278853 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: method: Jun 22 10:20:32.278853 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 22 10:20:32.279800 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1849723962', 'metadata': {'Type': 'work'}}}} Jun 22 10:20:32.279800 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:20:32.279800 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:20:32.279800 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 22 10:20:32.279800 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 22 10:20:32.279800 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 22 10:20:32.279800 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise error Jun 22 10:20:32.279800 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 22 10:20:32.279800 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:20:32.279800 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 22 10:20:32.279800 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 22 10:20:32.279800 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:20:32.279800 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 22 10:20:32.279800 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi '0' Jun 22 10:20:32.279800 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:20:32.279800 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:20:32.279800 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:20:32.279800 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:20:32.279800 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:20:32.279800 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:20:32.279800 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:20:32.279800 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:20:32.281577 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 10:20:32.281577 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 10:20:32.281577 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:20:32.281577 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:20:32.281577 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 22 10:20:32.281577 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 22 10:20:32.281577 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 22 10:20:32.281577 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 22 10:20:32.281577 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 22 10:20:32.281577 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 22 10:20:32.281577 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 22 10:20:32.281577 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:20:32.281577 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:20:32.281577 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:20:32.281577 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:20:32.281577 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:20:32.281577 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:20:32.281577 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 22 10:20:32.281577 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 22 10:20:32.287266 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 22 10:20:32.287266 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:20:32.287266 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-16c8af8c-707c-40f4-ba04-3e7b4f3f0494 tempest-VolumesNegativeTest-305655433 tempest-VolumesNegativeTest-305655433-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:20:32.287266 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-16c8af8c-707c-40f4-ba04-3e7b4f3f0494 tempest-VolumesNegativeTest-305655433 tempest-VolumesNegativeTest-305655433-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.022495 Jun 22 10:20:32.287266 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 2/2] 10.222.0.66 () {60 vars in 1155 bytes} [Wed Jun 22 10:20:32 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 22 10:20:32.300493 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-8bd7d8ea-5e4e-486c-8904-f8f48a2a2386 tempest-VolumesNegativeTest-305655433 tempest-VolumesNegativeTest-305655433-project] Action: 'create', calling method: .version_select at 0x7f60dc00caf0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1427849017", "metadata": {"Type": "work"}}} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:20:32.304692 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-8bd7d8ea-5e4e-486c-8904-f8f48a2a2386 tempest-VolumesNegativeTest-305655433 tempest-VolumesNegativeTest-305655433-project] Request method failure captured: Jun 22 10:20:32.304692 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 22 10:20:32.304692 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Accept: application/json Jun 22 10:20:32.304692 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Accept-Encoding: identity Jun 22 10:20:32.304692 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Connection: close Jun 22 10:20:32.304692 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Content-Length: 119 Jun 22 10:20:32.304692 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Content-Type: application/json Jun 22 10:20:32.304692 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Host: 10.222.0.66 Jun 22 10:20:32.304692 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Openstack-System-Scope: None Jun 22 10:20:32.304692 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: User-Agent: python-urllib3/1.26.9 Jun 22 10:20:32.304692 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Auth-Token: gAAAAABisuzujPnAR0zjYP7UmQJdwgY29_6z0BP9aP1B5FoFIMyoFPSWR8vRhj08ocC2yWv8YeYVu3gnpWUFE8WYSg24MpyuF5zNs_n29lB1bPFx2A7cpYR_-MNGLLeeLOymdNaIt07SRDv9ctlHIZAZCuLEBtbfGjX1fXzbJsnbrD3-p11O9Ks Jun 22 10:20:32.304692 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Domain-Id: None Jun 22 10:20:32.304692 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Domain-Name: None Jun 22 10:20:32.304692 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Identity-Status: Confirmed Jun 22 10:20:32.304692 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Is-Admin-Project: True Jun 22 10:20:32.304692 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Domain-Id: default Jun 22 10:20:32.304692 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Domain-Name: Default Jun 22 10:20:32.304692 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Id: 8b1b7d70b3b44138bd6f80d9b24ce476 Jun 22 10:20:32.304692 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Name: tempest-VolumesNegativeTest-305655433 Jun 22 10:20:32.304692 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Role: member,reader Jun 22 10:20:32.304692 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Roles: member,reader Jun 22 10:20:32.306100 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8b1b7d70b3b44138bd6f80d9b24ce476"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8b1b7d70b3b44138bd6f80d9b24ce476"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8b1b7d70b3b44138bd6f80d9b24ce476"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8b1b7d70b3b44138bd6f80d9b24ce476"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}] Jun 22 10:20:32.306100 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant: tempest-VolumesNegativeTest-305655433 Jun 22 10:20:32.306100 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant-Id: 8b1b7d70b3b44138bd6f80d9b24ce476 Jun 22 10:20:32.306100 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant-Name: tempest-VolumesNegativeTest-305655433 Jun 22 10:20:32.306100 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User: tempest-VolumesNegativeTest-305655433-project Jun 22 10:20:32.306100 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Domain-Id: default Jun 22 10:20:32.306100 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Domain-Name: Default Jun 22 10:20:32.306100 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Id: e6c1a85eee1549ebafcae52711e5d967 Jun 22 10:20:32.306100 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Name: tempest-VolumesNegativeTest-305655433-project Jun 22 10:20:32.306100 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Jun 22 10:20:32.306100 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1427849017", "metadata": {"Type": "work"}}} Jun 22 10:20:32.306100 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: method: Jun 22 10:20:32.306100 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 22 10:20:32.307205 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1427849017', 'metadata': {'Type': 'work'}}}} Jun 22 10:20:32.307205 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:20:32.307205 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:20:32.307205 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 22 10:20:32.307205 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 22 10:20:32.307205 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 22 10:20:32.307205 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise error Jun 22 10:20:32.307205 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 22 10:20:32.307205 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:20:32.307205 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 22 10:20:32.307205 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 22 10:20:32.307205 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:20:32.307205 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 22 10:20:32.307205 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi '' Jun 22 10:20:32.307205 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:20:32.307205 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:20:32.307205 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:20:32.307205 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:20:32.307205 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:20:32.307205 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:20:32.307205 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:20:32.307205 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:20:32.308618 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 10:20:32.308618 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 10:20:32.308618 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:20:32.308618 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:20:32.308618 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 22 10:20:32.308618 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 22 10:20:32.308618 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 22 10:20:32.308618 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 22 10:20:32.308618 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 22 10:20:32.308618 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 22 10:20:32.308618 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 22 10:20:32.308618 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:20:32.308618 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:20:32.308618 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:20:32.308618 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:20:32.308618 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:20:32.308618 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:20:32.308618 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 22 10:20:32.308618 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 22 10:20:32.314230 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 22 10:20:32.314230 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:20:32.317851 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-8bd7d8ea-5e4e-486c-8904-f8f48a2a2386 tempest-VolumesNegativeTest-305655433 tempest-VolumesNegativeTest-305655433-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:20:32.319571 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-8bd7d8ea-5e4e-486c-8904-f8f48a2a2386 tempest-VolumesNegativeTest-305655433 tempest-VolumesNegativeTest-305655433-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.026869 Jun 22 10:20:32.320768 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 3/3] 10.222.0.66 () {60 vars in 1155 bytes} [Wed Jun 22 10:20:32 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 22 10:20:32.331878 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-e5a23394-8f98-4344-8c58-9b0d50622516 tempest-VolumesNegativeTest-305655433 tempest-VolumesNegativeTest-305655433-project] Calling method '.version_select at 0x7f60dbeb7790>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:32.726327 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.wsgi [None req-e5a23394-8f98-4344-8c58-9b0d50622516 tempest-VolumesNegativeTest-305655433 tempest-VolumesNegativeTest-305655433-project] HTTP exception thrown: Volume tempest-invalid-1397043807 could not be found. Jun 22 10:20:32.735253 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-e5a23394-8f98-4344-8c58-9b0d50622516 tempest-VolumesNegativeTest-305655433 tempest-VolumesNegativeTest-305655433-project] Request method failure captured: Jun 22 10:20:32.735253 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1397043807 HTTP/1.1 Jun 22 10:20:32.735253 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Accept: application/json Jun 22 10:20:32.735253 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Accept-Encoding: identity Jun 22 10:20:32.735253 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Connection: close Jun 22 10:20:32.735253 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Content-Length: 0 Jun 22 10:20:32.735253 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Content-Type: application/json Jun 22 10:20:32.735253 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Host: 10.222.0.66 Jun 22 10:20:32.735253 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Openstack-System-Scope: None Jun 22 10:20:32.735253 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: User-Agent: python-urllib3/1.26.9 Jun 22 10:20:32.735253 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Auth-Token: gAAAAABisuzujPnAR0zjYP7UmQJdwgY29_6z0BP9aP1B5FoFIMyoFPSWR8vRhj08ocC2yWv8YeYVu3gnpWUFE8WYSg24MpyuF5zNs_n29lB1bPFx2A7cpYR_-MNGLLeeLOymdNaIt07SRDv9ctlHIZAZCuLEBtbfGjX1fXzbJsnbrD3-p11O9Ks Jun 22 10:20:32.735253 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Domain-Id: None Jun 22 10:20:32.735253 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Domain-Name: None Jun 22 10:20:32.735253 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Identity-Status: Confirmed Jun 22 10:20:32.735253 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Is-Admin-Project: True Jun 22 10:20:32.735253 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Domain-Id: default Jun 22 10:20:32.735253 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Domain-Name: Default Jun 22 10:20:32.735253 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Id: 8b1b7d70b3b44138bd6f80d9b24ce476 Jun 22 10:20:32.735253 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Name: tempest-VolumesNegativeTest-305655433 Jun 22 10:20:32.735253 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Role: member,reader Jun 22 10:20:32.735253 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Roles: member,reader Jun 22 10:20:32.736997 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8b1b7d70b3b44138bd6f80d9b24ce476"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8b1b7d70b3b44138bd6f80d9b24ce476"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8b1b7d70b3b44138bd6f80d9b24ce476"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8b1b7d70b3b44138bd6f80d9b24ce476"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}] Jun 22 10:20:32.736997 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant: tempest-VolumesNegativeTest-305655433 Jun 22 10:20:32.736997 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant-Id: 8b1b7d70b3b44138bd6f80d9b24ce476 Jun 22 10:20:32.736997 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant-Name: tempest-VolumesNegativeTest-305655433 Jun 22 10:20:32.736997 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User: tempest-VolumesNegativeTest-305655433-project Jun 22 10:20:32.736997 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Domain-Id: default Jun 22 10:20:32.736997 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Domain-Name: Default Jun 22 10:20:32.736997 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Id: e6c1a85eee1549ebafcae52711e5d967 Jun 22 10:20:32.736997 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Name: tempest-VolumesNegativeTest-305655433-project Jun 22 10:20:32.736997 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: method: Jun 22 10:20:32.736997 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: exception: Volume tempest-invalid-1397043807 could not be found. Jun 22 10:20:32.736997 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: action_args: {'id': 'tempest-invalid-1397043807'} Jun 22 10:20:32.736997 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:20:32.738007 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:20:32.738007 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 10:20:32.738007 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 10:20:32.738007 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 22 10:20:32.738007 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 22 10:20:32.738007 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 22 10:20:32.738007 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 22 10:20:32.738007 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 22 10:20:32.738007 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 22 10:20:32.738007 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 22 10:20:32.738007 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 22 10:20:32.738007 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 10:20:32.738007 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 10:20:32.738007 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 10:20:32.738007 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 10:20:32.738007 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1397043807 could not be found. (HTTP 404) (Request-ID: req-fe3a3cf6-b0ba-4d59-b2b3-61248e48c2a9) Jun 22 10:20:32.738007 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:20:32.738007 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:20:32.738007 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:20:32.739584 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:20:32.739584 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 22 10:20:32.739584 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 22 10:20:32.739584 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 10:20:32.739584 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 10:20:32.739584 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 22 10:20:32.739584 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 22 10:20:32.739584 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 10:20:32.739584 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 10:20:32.739584 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 10:20:32.739584 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 10:20:32.739584 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 22 10:20:32.739584 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 22 10:20:32.739584 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 22 10:20:32.739584 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 22 10:20:32.739584 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 22 10:20:32.739584 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 22 10:20:32.739584 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 22 10:20:32.739584 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 22 10:20:32.741017 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 10:20:32.741017 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 10:20:32.741017 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 10:20:32.741017 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 10:20:32.741017 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1397043807 could not be found. Jun 22 10:20:32.741017 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:20:32.741017 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:20:32.741017 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:20:32.741017 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:20:32.741017 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:20:32.741017 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:20:32.741017 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:20:32.741017 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:20:32.741017 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 10:20:32.741017 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 10:20:32.741017 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:20:32.741017 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:20:32.741017 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 22 10:20:32.741017 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:20:32.741017 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1397043807 could not be found. Jun 22 10:20:32.742488 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:20:32.742488 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:20:32.742488 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:20:32.742488 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:20:32.742488 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:20:32.742488 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:20:32.742488 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:20:32.742488 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:20:32.742488 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1397043807 could not be found. Jun 22 10:20:32.742488 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:20:32.749425 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-e5a23394-8f98-4344-8c58-9b0d50622516 tempest-VolumesNegativeTest-305655433 tempest-VolumesNegativeTest-305655433-project] Returning 404 to user: Volume tempest-invalid-1397043807 could not be found. {{(pid=117680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:20:32.751799 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-e5a23394-8f98-4344-8c58-9b0d50622516 tempest-VolumesNegativeTest-305655433 tempest-VolumesNegativeTest-305655433-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1397043807" status: 404 len: 99 microversion: 2.1 time: 0.424093 Jun 22 10:20:32.755278 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 4/4] 10.222.0.66 () {58 vars in 1217 bytes} [Wed Jun 22 10:20:32 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1397043807 => generated 99 bytes in 428 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 22 10:20:32.770131 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-f28a5c0f-e21b-4776-992a-4503dd6b7567 tempest-VolumesNegativeTest-305655433 tempest-VolumesNegativeTest-305655433-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008407 Jun 22 10:20:32.771021 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 5/5] 10.222.0.66 () {58 vars in 1139 bytes} [Wed Jun 22 10:20:32 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jun 22 10:20:32.786431 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-2c40e837-30fc-4585-baf3-01a7d15364c3 tempest-VolumesNegativeTest-305655433 tempest-VolumesNegativeTest-305655433-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005102 Jun 22 10:20:32.788427 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 6/6] 10.222.0.66 () {58 vars in 1136 bytes} [Wed Jun 22 10:20:32 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 22 10:20:32.806536 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-b58b9689-7324-4bbb-bed8-c7c6dd5db4e2 tempest-VolumesNegativeTest-305655433 tempest-VolumesNegativeTest-305655433-project] Calling method '.version_select at 0x7f60dbe6aa60>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:32.903455 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.wsgi [None req-b58b9689-7324-4bbb-bed8-c7c6dd5db4e2 tempest-VolumesNegativeTest-305655433 tempest-VolumesNegativeTest-305655433-project] HTTP exception thrown: Volume 6c6f3e34-dab7-4d63-8f53-642f7893fc7d could not be found. Jun 22 10:20:32.909707 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-b58b9689-7324-4bbb-bed8-c7c6dd5db4e2 tempest-VolumesNegativeTest-305655433 tempest-VolumesNegativeTest-305655433-project] Request method failure captured: Jun 22 10:20:32.909707 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: request: DELETE /compute/v2.1/os-volumes/6c6f3e34-dab7-4d63-8f53-642f7893fc7d HTTP/1.1 Jun 22 10:20:32.909707 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Accept: application/json Jun 22 10:20:32.909707 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Accept-Encoding: identity Jun 22 10:20:32.909707 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Connection: close Jun 22 10:20:32.909707 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Content-Length: 0 Jun 22 10:20:32.909707 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Content-Type: application/json Jun 22 10:20:32.909707 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Host: 10.222.0.66 Jun 22 10:20:32.909707 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Openstack-System-Scope: None Jun 22 10:20:32.909707 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: User-Agent: python-urllib3/1.26.9 Jun 22 10:20:32.909707 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Auth-Token: gAAAAABisuzujPnAR0zjYP7UmQJdwgY29_6z0BP9aP1B5FoFIMyoFPSWR8vRhj08ocC2yWv8YeYVu3gnpWUFE8WYSg24MpyuF5zNs_n29lB1bPFx2A7cpYR_-MNGLLeeLOymdNaIt07SRDv9ctlHIZAZCuLEBtbfGjX1fXzbJsnbrD3-p11O9Ks Jun 22 10:20:32.909707 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Domain-Id: None Jun 22 10:20:32.909707 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Domain-Name: None Jun 22 10:20:32.909707 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Identity-Status: Confirmed Jun 22 10:20:32.909707 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Is-Admin-Project: True Jun 22 10:20:32.909707 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Domain-Id: default Jun 22 10:20:32.909707 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Domain-Name: Default Jun 22 10:20:32.909707 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Id: 8b1b7d70b3b44138bd6f80d9b24ce476 Jun 22 10:20:32.909707 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Name: tempest-VolumesNegativeTest-305655433 Jun 22 10:20:32.909707 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Role: member,reader Jun 22 10:20:32.909707 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Roles: member,reader Jun 22 10:20:32.911476 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8b1b7d70b3b44138bd6f80d9b24ce476"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8b1b7d70b3b44138bd6f80d9b24ce476"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8b1b7d70b3b44138bd6f80d9b24ce476"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8b1b7d70b3b44138bd6f80d9b24ce476"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}] Jun 22 10:20:32.911476 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant: tempest-VolumesNegativeTest-305655433 Jun 22 10:20:32.911476 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant-Id: 8b1b7d70b3b44138bd6f80d9b24ce476 Jun 22 10:20:32.911476 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant-Name: tempest-VolumesNegativeTest-305655433 Jun 22 10:20:32.911476 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User: tempest-VolumesNegativeTest-305655433-project Jun 22 10:20:32.911476 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Domain-Id: default Jun 22 10:20:32.911476 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Domain-Name: Default Jun 22 10:20:32.911476 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Id: e6c1a85eee1549ebafcae52711e5d967 Jun 22 10:20:32.911476 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Name: tempest-VolumesNegativeTest-305655433-project Jun 22 10:20:32.911476 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: method: Jun 22 10:20:32.911476 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: exception: Volume 6c6f3e34-dab7-4d63-8f53-642f7893fc7d could not be found. Jun 22 10:20:32.911476 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: action_args: {'id': '6c6f3e34-dab7-4d63-8f53-642f7893fc7d'} Jun 22 10:20:32.911476 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:20:32.918164 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:20:32.918164 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 10:20:32.918164 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 10:20:32.918164 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 22 10:20:32.918164 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 22 10:20:32.918164 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 22 10:20:32.918164 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 22 10:20:32.918164 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 22 10:20:32.918164 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 22 10:20:32.918164 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 22 10:20:32.918164 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 22 10:20:32.918164 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 10:20:32.918164 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 10:20:32.918164 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 10:20:32.918164 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 10:20:32.918164 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6c6f3e34-dab7-4d63-8f53-642f7893fc7d could not be found. (HTTP 404) (Request-ID: req-01468215-1c35-4768-93fd-62510b540ab1) Jun 22 10:20:32.918164 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:20:32.918164 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:20:32.918164 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:20:32.919682 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:20:32.919682 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 22 10:20:32.919682 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 22 10:20:32.919682 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 10:20:32.919682 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 10:20:32.919682 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 22 10:20:32.919682 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 22 10:20:32.919682 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 10:20:32.919682 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 10:20:32.919682 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 10:20:32.919682 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 10:20:32.919682 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 22 10:20:32.919682 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 22 10:20:32.919682 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 22 10:20:32.919682 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 22 10:20:32.919682 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 22 10:20:32.919682 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 22 10:20:32.919682 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 22 10:20:32.919682 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 22 10:20:32.921253 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 10:20:32.921253 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 10:20:32.921253 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 10:20:32.921253 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 10:20:32.921253 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6c6f3e34-dab7-4d63-8f53-642f7893fc7d could not be found. Jun 22 10:20:32.921253 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:20:32.921253 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:20:32.921253 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:20:32.921253 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:20:32.921253 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:20:32.921253 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:20:32.921253 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:20:32.921253 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:20:32.921253 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 10:20:32.921253 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 10:20:32.921253 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:20:32.921253 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:20:32.921253 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 22 10:20:32.921253 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:20:32.922478 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6c6f3e34-dab7-4d63-8f53-642f7893fc7d could not be found. Jun 22 10:20:32.922478 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:20:32.922478 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:20:32.922478 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:20:32.922478 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:20:32.922478 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:20:32.922478 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:20:32.922478 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:20:32.922478 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:20:32.922478 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6c6f3e34-dab7-4d63-8f53-642f7893fc7d could not be found. Jun 22 10:20:32.922478 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:20:32.922478 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-b58b9689-7324-4bbb-bed8-c7c6dd5db4e2 tempest-VolumesNegativeTest-305655433 tempest-VolumesNegativeTest-305655433-project] Returning 404 to user: Volume 6c6f3e34-dab7-4d63-8f53-642f7893fc7d could not be found. {{(pid=117680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:20:32.922478 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-b58b9689-7324-4bbb-bed8-c7c6dd5db4e2 tempest-VolumesNegativeTest-305655433 tempest-VolumesNegativeTest-305655433-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/6c6f3e34-dab7-4d63-8f53-642f7893fc7d" status: 404 len: 109 microversion: 2.1 time: 0.118407 Jun 22 10:20:32.922478 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 7/7] 10.222.0.66 () {58 vars in 1247 bytes} [Wed Jun 22 10:20:32 2022] DELETE /compute/v2.1/os-volumes/6c6f3e34-dab7-4d63-8f53-642f7893fc7d => generated 109 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 22 10:20:32.927031 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-ed298ec9-dfa1-43dc-9334-fc9a091fa048 tempest-VolumesNegativeTest-305655433 tempest-VolumesNegativeTest-305655433-project] Calling method '.version_select at 0x7f60dbe6a5e0>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:33.008098 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.wsgi [None req-ed298ec9-dfa1-43dc-9334-fc9a091fa048 tempest-VolumesNegativeTest-305655433 tempest-VolumesNegativeTest-305655433-project] HTTP exception thrown: Volume 126e6bbb-2d73-4f20-baff-5e55a857c592 could not be found. Jun 22 10:20:33.010188 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-ed298ec9-dfa1-43dc-9334-fc9a091fa048 tempest-VolumesNegativeTest-305655433 tempest-VolumesNegativeTest-305655433-project] Request method failure captured: Jun 22 10:20:33.010188 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: request: GET /compute/v2.1/os-volumes/126e6bbb-2d73-4f20-baff-5e55a857c592 HTTP/1.1 Jun 22 10:20:33.010188 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Accept: application/json Jun 22 10:20:33.010188 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Accept-Encoding: identity Jun 22 10:20:33.010188 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Connection: close Jun 22 10:20:33.010188 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Content-Length: 0 Jun 22 10:20:33.010188 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Content-Type: application/json Jun 22 10:20:33.010188 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Host: 10.222.0.66 Jun 22 10:20:33.010188 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Openstack-System-Scope: None Jun 22 10:20:33.010188 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: User-Agent: python-urllib3/1.26.9 Jun 22 10:20:33.010188 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Auth-Token: gAAAAABisuzujPnAR0zjYP7UmQJdwgY29_6z0BP9aP1B5FoFIMyoFPSWR8vRhj08ocC2yWv8YeYVu3gnpWUFE8WYSg24MpyuF5zNs_n29lB1bPFx2A7cpYR_-MNGLLeeLOymdNaIt07SRDv9ctlHIZAZCuLEBtbfGjX1fXzbJsnbrD3-p11O9Ks Jun 22 10:20:33.010188 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Domain-Id: None Jun 22 10:20:33.010188 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Domain-Name: None Jun 22 10:20:33.010188 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Identity-Status: Confirmed Jun 22 10:20:33.010188 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Is-Admin-Project: True Jun 22 10:20:33.010188 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Domain-Id: default Jun 22 10:20:33.010188 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Domain-Name: Default Jun 22 10:20:33.010188 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Id: 8b1b7d70b3b44138bd6f80d9b24ce476 Jun 22 10:20:33.010188 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Name: tempest-VolumesNegativeTest-305655433 Jun 22 10:20:33.010188 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Role: member,reader Jun 22 10:20:33.010188 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Roles: member,reader Jun 22 10:20:33.011713 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8b1b7d70b3b44138bd6f80d9b24ce476"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8b1b7d70b3b44138bd6f80d9b24ce476"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8b1b7d70b3b44138bd6f80d9b24ce476"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8b1b7d70b3b44138bd6f80d9b24ce476"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}] Jun 22 10:20:33.011713 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant: tempest-VolumesNegativeTest-305655433 Jun 22 10:20:33.011713 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant-Id: 8b1b7d70b3b44138bd6f80d9b24ce476 Jun 22 10:20:33.011713 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant-Name: tempest-VolumesNegativeTest-305655433 Jun 22 10:20:33.011713 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User: tempest-VolumesNegativeTest-305655433-project Jun 22 10:20:33.011713 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Domain-Id: default Jun 22 10:20:33.011713 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Domain-Name: Default Jun 22 10:20:33.011713 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Id: e6c1a85eee1549ebafcae52711e5d967 Jun 22 10:20:33.011713 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Name: tempest-VolumesNegativeTest-305655433-project Jun 22 10:20:33.011713 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: method: Jun 22 10:20:33.011713 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: exception: Volume 126e6bbb-2d73-4f20-baff-5e55a857c592 could not be found. Jun 22 10:20:33.011713 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: action_args: {'id': '126e6bbb-2d73-4f20-baff-5e55a857c592'} Jun 22 10:20:33.011713 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:20:33.012579 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:20:33.012579 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 10:20:33.012579 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 10:20:33.012579 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 10:20:33.012579 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 10:20:33.012579 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 10:20:33.012579 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 10:20:33.012579 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 10:20:33.012579 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 10:20:33.012579 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 10:20:33.012579 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 10:20:33.012579 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 10:20:33.012579 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 10:20:33.012579 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 10:20:33.012579 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 10:20:33.012579 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 126e6bbb-2d73-4f20-baff-5e55a857c592 could not be found. (HTTP 404) (Request-ID: req-aa1aaa9a-8e12-4a41-820d-d178f4fcd00b) Jun 22 10:20:33.012579 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:20:33.012579 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:20:33.012579 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:20:33.022807 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:20:33.022807 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 22 10:20:33.022807 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 22 10:20:33.022807 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 10:20:33.022807 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 10:20:33.022807 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 22 10:20:33.022807 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 22 10:20:33.022807 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 10:20:33.022807 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 10:20:33.022807 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 10:20:33.022807 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 10:20:33.022807 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 10:20:33.022807 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 10:20:33.022807 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 10:20:33.022807 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 10:20:33.022807 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 10:20:33.022807 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 10:20:33.022807 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 10:20:33.022807 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 10:20:33.025425 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 10:20:33.025425 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 10:20:33.025425 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 10:20:33.025425 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 10:20:33.025425 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 126e6bbb-2d73-4f20-baff-5e55a857c592 could not be found. Jun 22 10:20:33.025425 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:20:33.025425 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:20:33.025425 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:20:33.025425 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:20:33.025425 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:20:33.025425 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:20:33.025425 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:20:33.025425 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:20:33.025425 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 10:20:33.025425 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 10:20:33.025425 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:20:33.025425 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:20:33.025425 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 22 10:20:33.025425 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:20:33.027280 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 126e6bbb-2d73-4f20-baff-5e55a857c592 could not be found. Jun 22 10:20:33.027280 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:20:33.027280 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:20:33.027280 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:20:33.027280 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:20:33.027280 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:20:33.027280 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:20:33.027280 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:20:33.027280 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:20:33.027280 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 126e6bbb-2d73-4f20-baff-5e55a857c592 could not be found. Jun 22 10:20:33.027280 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:20:33.027280 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-ed298ec9-dfa1-43dc-9334-fc9a091fa048 tempest-VolumesNegativeTest-305655433 tempest-VolumesNegativeTest-305655433-project] Returning 404 to user: Volume 126e6bbb-2d73-4f20-baff-5e55a857c592 could not be found. {{(pid=117680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:20:33.027280 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-ed298ec9-dfa1-43dc-9334-fc9a091fa048 tempest-VolumesNegativeTest-305655433 tempest-VolumesNegativeTest-305655433-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/126e6bbb-2d73-4f20-baff-5e55a857c592" status: 404 len: 109 microversion: 2.1 time: 0.094718 Jun 22 10:20:33.027280 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 8/8] 10.222.0.66 () {58 vars in 1244 bytes} [Wed Jun 22 10:20:32 2022] GET /compute/v2.1/os-volumes/126e6bbb-2d73-4f20-baff-5e55a857c592 => generated 109 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 22 10:20:33.835973 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-9e2a5146-3c31-4f07-a0e4-5cc53395d1f9 tempest-VolumesGetTestJSON-1635429826 tempest-VolumesGetTestJSON-1635429826-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.658054 Jun 22 10:20:33.842145 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 1/9] 10.222.0.66 () {60 vars in 1155 bytes} [Wed Jun 22 10:20:31 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 2666 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jun 22 10:20:33.854377 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-f9dc4d9a-1a35-47a7-97d7-c61e84ff2021 tempest-VolumesGetTestJSON-1635429826 tempest-VolumesGetTestJSON-1635429826-project] Calling method '.version_select at 0x7f60dbf93dc0>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:33.972986 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-f9dc4d9a-1a35-47a7-97d7-c61e84ff2021 tempest-VolumesGetTestJSON-1635429826 tempest-VolumesGetTestJSON-1635429826-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/dddee7dd-fbcd-44db-9503-8749f469f7f2" status: 200 len: 353 microversion: 2.1 time: 0.122655 Jun 22 10:20:33.973599 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 9/10] 10.222.0.66 () {58 vars in 1244 bytes} [Wed Jun 22 10:20:33 2022] GET /compute/v2.1/os-volumes/dddee7dd-fbcd-44db-9503-8749f469f7f2 => generated 353 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:20:34.987467 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-fc947e49-f50b-48ce-a0d4-765f752bcc6d tempest-VolumesGetTestJSON-1635429826 tempest-VolumesGetTestJSON-1635429826-project] Calling method '.version_select at 0x7f60dbed8550>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:35.135320 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-fc947e49-f50b-48ce-a0d4-765f752bcc6d tempest-VolumesGetTestJSON-1635429826 tempest-VolumesGetTestJSON-1635429826-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/dddee7dd-fbcd-44db-9503-8749f469f7f2" status: 200 len: 353 microversion: 2.1 time: 0.153386 Jun 22 10:20:35.135944 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 2/11] 10.222.0.66 () {58 vars in 1244 bytes} [Wed Jun 22 10:20:34 2022] GET /compute/v2.1/os-volumes/dddee7dd-fbcd-44db-9503-8749f469f7f2 => generated 353 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:20:36.149939 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-3d998283-6f76-48ed-8ee3-23730918ca9c tempest-VolumesGetTestJSON-1635429826 tempest-VolumesGetTestJSON-1635429826-project] Calling method '.version_select at 0x7f60dbe8eee0>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:36.244543 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-3d998283-6f76-48ed-8ee3-23730918ca9c tempest-VolumesGetTestJSON-1635429826 tempest-VolumesGetTestJSON-1635429826-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/dddee7dd-fbcd-44db-9503-8749f469f7f2" status: 200 len: 354 microversion: 2.1 time: 0.100144 Jun 22 10:20:36.245461 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 10/12] 10.222.0.66 () {58 vars in 1244 bytes} [Wed Jun 22 10:20:36 2022] GET /compute/v2.1/os-volumes/dddee7dd-fbcd-44db-9503-8749f469f7f2 => generated 354 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:20:36.259694 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-791c24d0-b64d-4fdc-8d86-3f0d8f5570a7 tempest-VolumesGetTestJSON-1635429826 tempest-VolumesGetTestJSON-1635429826-project] Calling method '.version_select at 0x7f60dbed8790>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:36.345624 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-791c24d0-b64d-4fdc-8d86-3f0d8f5570a7 tempest-VolumesGetTestJSON-1635429826 tempest-VolumesGetTestJSON-1635429826-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/dddee7dd-fbcd-44db-9503-8749f469f7f2" status: 200 len: 354 microversion: 2.1 time: 0.092709 Jun 22 10:20:36.346199 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 3/13] 10.222.0.66 () {58 vars in 1244 bytes} [Wed Jun 22 10:20:36 2022] GET /compute/v2.1/os-volumes/dddee7dd-fbcd-44db-9503-8749f469f7f2 => generated 354 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:20:36.361566 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-af4667e0-812e-4149-b8f9-0328d76e5b16 tempest-VolumesGetTestJSON-1635429826 tempest-VolumesGetTestJSON-1635429826-project] Calling method '.version_select at 0x7f60dbe6a310>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:36.476598 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-af4667e0-812e-4149-b8f9-0328d76e5b16 tempest-VolumesGetTestJSON-1635429826 tempest-VolumesGetTestJSON-1635429826-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/dddee7dd-fbcd-44db-9503-8749f469f7f2" status: 202 len: 0 microversion: 2.1 time: 0.120014 Jun 22 10:20:36.477176 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 11/14] 10.222.0.66 () {58 vars in 1247 bytes} [Wed Jun 22 10:20:36 2022] DELETE /compute/v2.1/os-volumes/dddee7dd-fbcd-44db-9503-8749f469f7f2 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:20:36.488882 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-5e3336f7-414d-4345-b76a-832603230565 tempest-VolumesGetTestJSON-1635429826 tempest-VolumesGetTestJSON-1635429826-project] Calling method '.version_select at 0x7f60dbed8ca0>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:36.593898 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-5e3336f7-414d-4345-b76a-832603230565 tempest-VolumesGetTestJSON-1635429826 tempest-VolumesGetTestJSON-1635429826-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/dddee7dd-fbcd-44db-9503-8749f469f7f2" status: 200 len: 353 microversion: 2.1 time: 0.109406 Jun 22 10:20:36.602117 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 4/15] 10.222.0.66 () {58 vars in 1244 bytes} [Wed Jun 22 10:20:36 2022] GET /compute/v2.1/os-volumes/dddee7dd-fbcd-44db-9503-8749f469f7f2 => generated 353 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:20:37.609716 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-6d1f8a1b-b0f2-4b4d-a38d-6d2b93ddadc5 tempest-VolumesGetTestJSON-1635429826 tempest-VolumesGetTestJSON-1635429826-project] Calling method '.version_select at 0x7f60dbdfa310>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:37.662407 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.wsgi [None req-6d1f8a1b-b0f2-4b4d-a38d-6d2b93ddadc5 tempest-VolumesGetTestJSON-1635429826 tempest-VolumesGetTestJSON-1635429826-project] HTTP exception thrown: Volume dddee7dd-fbcd-44db-9503-8749f469f7f2 could not be found. Jun 22 10:20:37.664420 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-6d1f8a1b-b0f2-4b4d-a38d-6d2b93ddadc5 tempest-VolumesGetTestJSON-1635429826 tempest-VolumesGetTestJSON-1635429826-project] Request method failure captured: Jun 22 10:20:37.664420 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: request: GET /compute/v2.1/os-volumes/dddee7dd-fbcd-44db-9503-8749f469f7f2 HTTP/1.1 Jun 22 10:20:37.664420 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Accept: application/json Jun 22 10:20:37.664420 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Accept-Encoding: identity Jun 22 10:20:37.664420 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Connection: close Jun 22 10:20:37.664420 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Content-Length: 0 Jun 22 10:20:37.664420 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Content-Type: application/json Jun 22 10:20:37.664420 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Host: 10.222.0.66 Jun 22 10:20:37.664420 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Openstack-System-Scope: None Jun 22 10:20:37.664420 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: User-Agent: python-urllib3/1.26.9 Jun 22 10:20:37.664420 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Auth-Token: gAAAAABisuzvruWXvgOTRrHDxaD8ju2zB5quCrsTj8C1xSTzhP95OZwix9KVYRdv545AFN812aWEkQec-ro-H4FqUErl3ZUDx_UST_HS2tof6WGHgzcNd3hrBksD-lwxsosuoDJlGMPzurXqHXGy2qPViHIa4TpQxV9JNRymRiKnyzFrkVOqupg Jun 22 10:20:37.664420 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Domain-Id: None Jun 22 10:20:37.664420 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Domain-Name: None Jun 22 10:20:37.664420 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Identity-Status: Confirmed Jun 22 10:20:37.664420 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Is-Admin-Project: True Jun 22 10:20:37.664420 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Domain-Id: default Jun 22 10:20:37.664420 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Domain-Name: Default Jun 22 10:20:37.664420 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Id: 9ca668ca0fd74d5b807f7f03038e4ac1 Jun 22 10:20:37.664420 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Name: tempest-VolumesGetTestJSON-1635429826 Jun 22 10:20:37.664420 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Role: member,reader Jun 22 10:20:37.664420 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Roles: member,reader Jun 22 10:20:37.665539 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9ca668ca0fd74d5b807f7f03038e4ac1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9ca668ca0fd74d5b807f7f03038e4ac1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9ca668ca0fd74d5b807f7f03038e4ac1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9ca668ca0fd74d5b807f7f03038e4ac1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}] Jun 22 10:20:37.665539 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant: tempest-VolumesGetTestJSON-1635429826 Jun 22 10:20:37.665539 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant-Id: 9ca668ca0fd74d5b807f7f03038e4ac1 Jun 22 10:20:37.665539 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant-Name: tempest-VolumesGetTestJSON-1635429826 Jun 22 10:20:37.665539 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User: tempest-VolumesGetTestJSON-1635429826-project Jun 22 10:20:37.665539 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Domain-Id: default Jun 22 10:20:37.665539 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Domain-Name: Default Jun 22 10:20:37.665539 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Id: 560a544c56114d7a8da2eece7fba5e3a Jun 22 10:20:37.665539 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Name: tempest-VolumesGetTestJSON-1635429826-project Jun 22 10:20:37.665539 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: method: Jun 22 10:20:37.665539 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: exception: Volume dddee7dd-fbcd-44db-9503-8749f469f7f2 could not be found. Jun 22 10:20:37.665539 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: action_args: {'id': 'dddee7dd-fbcd-44db-9503-8749f469f7f2'} Jun 22 10:20:37.665539 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:20:37.666350 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:20:37.666350 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 10:20:37.666350 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 10:20:37.666350 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 10:20:37.666350 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 10:20:37.666350 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 10:20:37.666350 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 10:20:37.666350 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 10:20:37.666350 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 10:20:37.666350 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 10:20:37.666350 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 10:20:37.666350 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 10:20:37.666350 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 10:20:37.666350 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 10:20:37.666350 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 10:20:37.666350 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume dddee7dd-fbcd-44db-9503-8749f469f7f2 could not be found. (HTTP 404) (Request-ID: req-ac1600e0-3430-4914-a6ae-e0e8903ac704) Jun 22 10:20:37.666350 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:20:37.666350 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:20:37.666350 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:20:37.667386 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:20:37.667386 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 22 10:20:37.667386 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 22 10:20:37.667386 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 10:20:37.667386 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 10:20:37.667386 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 22 10:20:37.667386 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 22 10:20:37.667386 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 10:20:37.667386 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 10:20:37.667386 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 10:20:37.667386 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 10:20:37.667386 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 10:20:37.667386 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 10:20:37.667386 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 10:20:37.667386 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 10:20:37.667386 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 10:20:37.667386 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 10:20:37.667386 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 10:20:37.667386 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 10:20:37.668279 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 10:20:37.668279 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 10:20:37.668279 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 10:20:37.668279 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 10:20:37.668279 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume dddee7dd-fbcd-44db-9503-8749f469f7f2 could not be found. Jun 22 10:20:37.668279 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:20:37.668279 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:20:37.668279 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:20:37.668279 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:20:37.668279 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:20:37.668279 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:20:37.668279 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:20:37.668279 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:20:37.668279 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 10:20:37.668279 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 10:20:37.668279 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:20:37.668279 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:20:37.668279 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 22 10:20:37.668279 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:20:37.671320 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume dddee7dd-fbcd-44db-9503-8749f469f7f2 could not be found. Jun 22 10:20:37.671320 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:20:37.671320 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:20:37.671320 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:20:37.671320 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:20:37.671320 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:20:37.671320 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:20:37.671320 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:20:37.671320 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:20:37.671320 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume dddee7dd-fbcd-44db-9503-8749f469f7f2 could not be found. Jun 22 10:20:37.671320 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:20:37.671320 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-6d1f8a1b-b0f2-4b4d-a38d-6d2b93ddadc5 tempest-VolumesGetTestJSON-1635429826 tempest-VolumesGetTestJSON-1635429826-project] Returning 404 to user: Volume dddee7dd-fbcd-44db-9503-8749f469f7f2 could not be found. {{(pid=117680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:20:37.671320 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-6d1f8a1b-b0f2-4b4d-a38d-6d2b93ddadc5 tempest-VolumesGetTestJSON-1635429826 tempest-VolumesGetTestJSON-1635429826-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/dddee7dd-fbcd-44db-9503-8749f469f7f2" status: 404 len: 109 microversion: 2.1 time: 0.060489 Jun 22 10:20:37.671320 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 12/16] 10.222.0.66 () {58 vars in 1244 bytes} [Wed Jun 22 10:20:37 2022] GET /compute/v2.1/os-volumes/dddee7dd-fbcd-44db-9503-8749f469f7f2 => generated 109 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:20:40.052165 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-4e313318-d9c5-4ff9-8c30-c5aa44608c05 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1608974619", "imageRef": "58addf50-5317-403a-beb0-4760bdbcaa13", "flavorRef": "452", "networks": [{"uuid": "89d39410-7337-441b-84c2-4e27ee74df9a"}]}} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:20:40.238921 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.network.neutron [None req-4e313318-d9c5-4ff9-8c30-c5aa44608c05 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] validate_networks() for [('89d39410-7337-441b-84c2-4e27ee74df9a', None, None, None, None, None)] {{(pid=117679) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 10:20:44.620835 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-4dc6cdad-2765-4b8f-a6da-2c8e8cf5f1a3 tempest-VolumesTestJSON-1000861123 tempest-VolumesTestJSON-1000861123-project] Calling method '.version_select at 0x7f60dbe6a670>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:44.757489 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-4dc6cdad-2765-4b8f-a6da-2c8e8cf5f1a3 tempest-VolumesTestJSON-1000861123 tempest-VolumesTestJSON-1000861123-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/e9445816-0488-4982-a708-8a2e2dbbd9af" status: 200 len: 350 microversion: 2.1 time: 0.141117 Jun 22 10:20:44.758454 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 13/17] 10.222.0.66 () {58 vars in 1244 bytes} [Wed Jun 22 10:20:44 2022] GET /compute/v2.1/os-volumes/e9445816-0488-4982-a708-8a2e2dbbd9af => generated 350 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:20:45.254637 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-4e313318-d9c5-4ff9-8c30-c5aa44608c05 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Flavor limits 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 10:20:45.255220 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-4e313318-d9c5-4ff9-8c30-c5aa44608c05 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Image limits 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 10:20:45.255812 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-4e313318-d9c5-4ff9-8c30-c5aa44608c05 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Flavor pref 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 10:20:45.256294 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-4e313318-d9c5-4ff9-8c30-c5aa44608c05 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Image pref 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 10:20:45.257036 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-4e313318-d9c5-4ff9-8c30-c5aa44608c05 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 10:20:45.322469 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4e313318-d9c5-4ff9-8c30-c5aa44608c05 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:45.322964 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4e313318-d9c5-4ff9-8c30-c5aa44608c05 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:45.330446 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4e313318-d9c5-4ff9-8c30-c5aa44608c05 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:45.331044 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4e313318-d9c5-4ff9-8c30-c5aa44608c05 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:45.506330 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.quota [None req-4e313318-d9c5-4ff9-8c30-c5aa44608c05 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Getting quotas for project 3e253dfe684b469383c18ff8c2a3dbd9. Resources: {'instances', 'cores', 'ram'} {{(pid=117679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:20:45.537661 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.quota [None req-4e313318-d9c5-4ff9-8c30-c5aa44608c05 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Getting quotas for user 96d2a62272e248d3b11aca8737e22fb2 and project 3e253dfe684b469383c18ff8c2a3dbd9. Resources: {'instances', 'cores', 'ram'} {{(pid=117679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:20:45.597299 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-4e313318-d9c5-4ff9-8c30-c5aa44608c05 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Going to run 1 instances... {{(pid=117679) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 10:20:45.603559 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-4e313318-d9c5-4ff9-8c30-c5aa44608c05 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] [instance: 76efde76-215b-4c32-992f-3fe518470987] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58addf50-5317-403a-beb0-4760bdbcaa13',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 10:20:45.829370 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-4e313318-d9c5-4ff9-8c30-c5aa44608c05 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.058902 Jun 22 10:20:45.830219 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 5/18] 10.222.0.66 () {60 vars in 1146 bytes} [Wed Jun 22 10:20:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 6061 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 10:20:45.842114 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-0b12da9a-7dbd-46d0-b2e7-03248aa6a3d3 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:45.843040 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-0b12da9a-7dbd-46d0-b2e7-03248aa6a3d3 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] [instance: 76efde76-215b-4c32-992f-3fe518470987] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:46.266722 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-0b12da9a-7dbd-46d0-b2e7-03248aa6a3d3 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d2a62272e248d3b11aca8737e22fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e253dfe684b469383c18ff8c2a3dbd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:46.296408 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-0b12da9a-7dbd-46d0-b2e7-03248aa6a3d3 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] 10.222.0.66 "GET /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987" status: 200 len: 1215 microversion: 2.1 time: 0.456741 Jun 22 10:20:46.301060 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 14/19] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:45 2022] GET /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987 => generated 1215 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:46.531892 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-f1e75a8a-6646-448c-8a50-20516a5f3388 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Action: 'create', calling method: .version_select at 0x7f60db581040>, body: {"keypair": {"name": "tempest-keypair-2113087024", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAupSiqtNJNinz/cLzzUBwfEsvXdvYK67XR62yDqg2pxaSeWLyhkp0PFnARBU1ZR9ZHx/zKB/SR/2C0gBpqrHnX32xJqg53dji+3YpRIObnBHwGT5UvBU6FhW6zOXLIE0A=="}} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:20:46.585320 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.quota [None req-f1e75a8a-6646-448c-8a50-20516a5f3388 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Getting quotas for project 5d4c799515b04fff924caa9819be4faf. Resources: {'key_pairs'} {{(pid=117679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:20:46.607343 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.quota [None req-f1e75a8a-6646-448c-8a50-20516a5f3388 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Getting quotas for user 60dbe36087e14f9e8bf885977b0e7426 and project 5d4c799515b04fff924caa9819be4faf. Resources: {'key_pairs'} {{(pid=117679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:20:46.751206 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-f1e75a8a-6646-448c-8a50-20516a5f3388 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.600187 Jun 22 10:20:46.757906 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 6/20] 10.222.0.66 () {62 vars in 1199 bytes} [Wed Jun 22 10:20:46 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 602 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jun 22 10:20:47.318805 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-ded53d5f-dac1-43dc-af26-347d52d4bb17 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:47.319437 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-ded53d5f-dac1-43dc-af26-347d52d4bb17 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] [instance: 76efde76-215b-4c32-992f-3fe518470987] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:47.808189 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-ded53d5f-dac1-43dc-af26-347d52d4bb17 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d2a62272e248d3b11aca8737e22fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e253dfe684b469383c18ff8c2a3dbd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:47.840823 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-ded53d5f-dac1-43dc-af26-347d52d4bb17 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] 10.222.0.66 "GET /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987" status: 200 len: 1215 microversion: 2.1 time: 0.525986 Jun 22 10:20:47.854957 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 15/21] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:47 2022] GET /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987 => generated 1215 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:48.890649 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-59fcceec-4ff3-486e-92a9-bb7517a87b84 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:48.893377 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-59fcceec-4ff3-486e-92a9-bb7517a87b84 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] [instance: 76efde76-215b-4c32-992f-3fe518470987] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:48.914893 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-59fcceec-4ff3-486e-92a9-bb7517a87b84 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:48.915782 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-59fcceec-4ff3-486e-92a9-bb7517a87b84 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:48.919781 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-59fcceec-4ff3-486e-92a9-bb7517a87b84 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:48.935817 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-59fcceec-4ff3-486e-92a9-bb7517a87b84 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:49.226361 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-59fcceec-4ff3-486e-92a9-bb7517a87b84 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d2a62272e248d3b11aca8737e22fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e253dfe684b469383c18ff8c2a3dbd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:49.258929 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-59fcceec-4ff3-486e-92a9-bb7517a87b84 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] 10.222.0.66 "GET /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987" status: 200 len: 1219 microversion: 2.1 time: 0.400200 Jun 22 10:20:49.262201 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 7/22] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:48 2022] GET /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987 => generated 1219 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:50.049329 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-a68c3caf-2cd4-4139-b596-b4e42d3296ba tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Action: 'create', calling method: .version_select at 0x7f60dbe6a790>, body: {"keypair": {"name": "tempest-keypair-1166184984", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOoyblQkKkvoPcWAssIh6VJh70gnJBSnutKFDYDTE+1X49kH25jOOonKw+OzTLFrItZyHomr/D3eo+zt0Ai0H+9RZd5mXqrOiBWCOqbo2ZtOZ5zh4Wf+WvoqFazONzHnGw=="}} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:20:50.133393 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.quota [None req-a68c3caf-2cd4-4139-b596-b4e42d3296ba tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Getting quotas for project fecb66f4a7094cd3963caf460c52b88b. Resources: {'key_pairs'} {{(pid=117680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:20:50.167131 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.quota [None req-a68c3caf-2cd4-4139-b596-b4e42d3296ba tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Getting quotas for user 595531abf958489795f2363026697a5b and project fecb66f4a7094cd3963caf460c52b88b. Resources: {'key_pairs'} {{(pid=117680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:20:50.279866 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-f50bdd4c-6cbc-4979-bceb-791df72641ca tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:50.281104 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-f50bdd4c-6cbc-4979-bceb-791df72641ca tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] [instance: 76efde76-215b-4c32-992f-3fe518470987] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:50.294885 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f50bdd4c-6cbc-4979-bceb-791df72641ca tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:50.299074 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f50bdd4c-6cbc-4979-bceb-791df72641ca tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:50.304755 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f50bdd4c-6cbc-4979-bceb-791df72641ca tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:50.309116 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f50bdd4c-6cbc-4979-bceb-791df72641ca tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:50.312687 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-a68c3caf-2cd4-4139-b596-b4e42d3296ba tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.940032 Jun 22 10:20:50.313495 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 16/23] 10.222.0.66 () {60 vars in 1158 bytes} [Wed Jun 22 10:20:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:20:50.561750 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-f50bdd4c-6cbc-4979-bceb-791df72641ca tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d2a62272e248d3b11aca8737e22fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e253dfe684b469383c18ff8c2a3dbd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:50.572087 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-f50bdd4c-6cbc-4979-bceb-791df72641ca tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] 10.222.0.66 "GET /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987" status: 200 len: 1219 microversion: 2.1 time: 0.297281 Jun 22 10:20:50.588506 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 8/24] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:50 2022] GET /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987 => generated 1219 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:20:50.857922 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-9dc9ca18-ec8f-49e4-a568-9cf661ec7ab9 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Action: 'create', calling method: .version_select at 0x7f60db52f0d0>, body: {"keypair": {"name": "tempest-keypair-687818091", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMsprage8qkJrlXsdXHeOXd4e4bChLy0bPxY/cm6j9H5RVzEh2xtP83lNglSHg6lfPH8mVz+hgtoTVGoZ+C5YVdZxdWYlHA5FpWD85dRMe05+pYUCVOxRTAneJ3XxNNxrg=="}} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:20:50.964584 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.quota [None req-9dc9ca18-ec8f-49e4-a568-9cf661ec7ab9 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Getting quotas for project 1db3fe97f51f47a98da3cbc8f0d55741. Resources: {'key_pairs'} {{(pid=117680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:20:50.982612 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.quota [None req-9dc9ca18-ec8f-49e4-a568-9cf661ec7ab9 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Getting quotas for user da80b9a52feb462faf0469f2ab701fb8 and project 1db3fe97f51f47a98da3cbc8f0d55741. Resources: {'key_pairs'} {{(pid=117680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:20:51.092989 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-9dc9ca18-ec8f-49e4-a568-9cf661ec7ab9 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.637263 Jun 22 10:20:51.102473 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 17/25] 10.222.0.66 () {60 vars in 1158 bytes} [Wed Jun 22 10:20:50 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:20:51.624801 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-f8d24976-09c1-470d-af1d-9acaddac568e tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:51.625442 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-f8d24976-09c1-470d-af1d-9acaddac568e tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] [instance: 76efde76-215b-4c32-992f-3fe518470987] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:51.642202 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f8d24976-09c1-470d-af1d-9acaddac568e tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:51.647735 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f8d24976-09c1-470d-af1d-9acaddac568e tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:51.650979 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f8d24976-09c1-470d-af1d-9acaddac568e tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:51.653853 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f8d24976-09c1-470d-af1d-9acaddac568e tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:52.023901 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-f8d24976-09c1-470d-af1d-9acaddac568e tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d2a62272e248d3b11aca8737e22fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e253dfe684b469383c18ff8c2a3dbd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:52.045555 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-f8d24976-09c1-470d-af1d-9acaddac568e tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] 10.222.0.66 "GET /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987" status: 200 len: 1267 microversion: 2.1 time: 0.442915 Jun 22 10:20:52.052314 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 9/26] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:51 2022] GET /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987 => generated 1267 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:52.489790 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-7e2b8146-decf-49f1-a062-8f2027e663b8 tempest-VolumesTestJSON-1000861123 tempest-VolumesTestJSON-1000861123-project] Calling method '.version_select at 0x7f60db556e50>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:52.628446 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-7e2b8146-decf-49f1-a062-8f2027e663b8 tempest-VolumesTestJSON-1000861123 tempest-VolumesTestJSON-1000861123-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/012f8f0a-c28d-4b72-b04e-2bd3dfc50aed" status: 200 len: 351 microversion: 2.1 time: 0.142890 Jun 22 10:20:52.629860 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 18/27] 10.222.0.66 () {58 vars in 1244 bytes} [Wed Jun 22 10:20:52 2022] GET /compute/v2.1/os-volumes/012f8f0a-c28d-4b72-b04e-2bd3dfc50aed => generated 351 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:20:53.069989 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-3331b2d8-489c-4593-a392-1108f905ec4c tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:53.070807 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-3331b2d8-489c-4593-a392-1108f905ec4c tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] [instance: 76efde76-215b-4c32-992f-3fe518470987] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:53.083191 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3331b2d8-489c-4593-a392-1108f905ec4c tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:53.083676 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3331b2d8-489c-4593-a392-1108f905ec4c tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:53.085684 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3331b2d8-489c-4593-a392-1108f905ec4c tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:53.086305 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3331b2d8-489c-4593-a392-1108f905ec4c tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:53.701942 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-612b489a-8dfb-4378-8bc0-cb2d6469d5a2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1540644877", "imageRef": "58addf50-5317-403a-beb0-4760bdbcaa13", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "23bcbab7-3391-489e-8f1d-2df2c9649acc"}], "security_groups": [{"name": "tempest-securitygroup--2095063854"}], "key_name": "tempest-keypair-2113087024", "user_data": "}} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:20:54.140289 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-3331b2d8-489c-4593-a392-1108f905ec4c tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d2a62272e248d3b11aca8737e22fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e253dfe684b469383c18ff8c2a3dbd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:54.153485 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-3331b2d8-489c-4593-a392-1108f905ec4c tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] 10.222.0.66 "GET /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987" status: 200 len: 1273 microversion: 2.1 time: 1.088187 Jun 22 10:20:54.155279 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 10/28] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:53 2022] GET /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987 => generated 1273 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:54.460562 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.network.neutron [None req-612b489a-8dfb-4378-8bc0-cb2d6469d5a2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] validate_networks() for [('23bcbab7-3391-489e-8f1d-2df2c9649acc', None, None, None, None, None)] {{(pid=117680) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 10:20:54.569055 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-e201ad65-3b8f-41b4-93dc-9b1efbb4eeab tempest-VolumesTestJSON-1000861123 tempest-VolumesTestJSON-1000861123-project] Calling method '.version_select at 0x7f60db583c10>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:54.779724 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-e201ad65-3b8f-41b4-93dc-9b1efbb4eeab tempest-VolumesTestJSON-1000861123 tempest-VolumesTestJSON-1000861123-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/aa60af64-dd68-400a-b0a3-3162dab76037" status: 200 len: 350 microversion: 2.1 time: 0.228072 Jun 22 10:20:54.780339 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 11/29] 10.222.0.66 () {58 vars in 1244 bytes} [Wed Jun 22 10:20:54 2022] GET /compute/v2.1/os-volumes/aa60af64-dd68-400a-b0a3-3162dab76037 => generated 350 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:20:54.796243 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-4d538654-758c-4c97-938c-8f16b0b1c023 tempest-VolumesTestJSON-1000861123 tempest-VolumesTestJSON-1000861123-project] Calling method '.version_select at 0x7f60da4ba5e0>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:55.071668 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-4d538654-758c-4c97-938c-8f16b0b1c023 tempest-VolumesTestJSON-1000861123 tempest-VolumesTestJSON-1000861123-project] 10.222.0.66 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.283162 Jun 22 10:20:55.074906 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 12/30] 10.222.0.66 () {58 vars in 1133 bytes} [Wed Jun 22 10:20:54 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:55.096744 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-26e88644-9acf-42d4-9362-bb54a168ef1d tempest-VolumesTestJSON-1000861123 tempest-VolumesTestJSON-1000861123-project] Calling method '.version_select at 0x7f60da491f70>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:55.395131 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-26e88644-9acf-42d4-9362-bb54a168ef1d tempest-VolumesTestJSON-1000861123 tempest-VolumesTestJSON-1000861123-project] 10.222.0.66 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.311646 Jun 22 10:20:55.396009 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 13/31] 10.222.0.66 () {58 vars in 1148 bytes} [Wed Jun 22 10:20:55 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:20:55.402392 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-e7ffd321-4257-485a-a91c-83aca13b2252 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:55.403070 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-e7ffd321-4257-485a-a91c-83aca13b2252 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] [instance: 76efde76-215b-4c32-992f-3fe518470987] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:55.433363 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_cell0:SELECT=2 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:55.449139 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e7ffd321-4257-485a-a91c-83aca13b2252 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:55.451984 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e7ffd321-4257-485a-a91c-83aca13b2252 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:55.452896 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e7ffd321-4257-485a-a91c-83aca13b2252 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:55.453343 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e7ffd321-4257-485a-a91c-83aca13b2252 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:55.832655 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-e7ffd321-4257-485a-a91c-83aca13b2252 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d2a62272e248d3b11aca8737e22fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e253dfe684b469383c18ff8c2a3dbd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:55.869906 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-e7ffd321-4257-485a-a91c-83aca13b2252 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] 10.222.0.66 "GET /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987" status: 200 len: 1273 microversion: 2.1 time: 0.472623 Jun 22 10:20:55.871538 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 14/32] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:55 2022] GET /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987 => generated 1273 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:55.880225 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-eef6721b-0e83-464d-9231-29cadf8317dc tempest-VolumesTestJSON-1000861123 tempest-VolumesTestJSON-1000861123-project] Calling method '.version_select at 0x7f60da4d5ca0>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:56.256989 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-eef6721b-0e83-464d-9231-29cadf8317dc tempest-VolumesTestJSON-1000861123 tempest-VolumesTestJSON-1000861123-project] 10.222.0.66 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.382773 Jun 22 10:20:56.258178 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 15/33] 10.222.0.66 () {58 vars in 1133 bytes} [Wed Jun 22 10:20:55 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:56.271633 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-3fa3c825-0ae0-44b6-af9c-4202ba891a85 tempest-VolumesTestJSON-1000861123 tempest-VolumesTestJSON-1000861123-project] Calling method '.version_select at 0x7f60da491940>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:56.541713 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-3fa3c825-0ae0-44b6-af9c-4202ba891a85 tempest-VolumesTestJSON-1000861123 tempest-VolumesTestJSON-1000861123-project] 10.222.0.66 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.275252 Jun 22 10:20:56.543622 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 16/34] 10.222.0.66 () {58 vars in 1166 bytes} [Wed Jun 22 10:20:56 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:20:56.556377 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-b856564d-ec6f-4cfe-aadb-8fd3ba6ea6b6 tempest-VolumesTestJSON-1000861123 tempest-VolumesTestJSON-1000861123-project] Calling method '.version_select at 0x7f60da4a0b80>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:56.644779 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_cell0:SELECT=10 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:20:56.880335 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-b856564d-ec6f-4cfe-aadb-8fd3ba6ea6b6 tempest-VolumesTestJSON-1000861123 tempest-VolumesTestJSON-1000861123-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.328864 Jun 22 10:20:56.881273 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 17/35] 10.222.0.66 () {58 vars in 1169 bytes} [Wed Jun 22 10:20:56 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:20:56.892520 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-0571c572-dc7b-4e91-b061-8c259394ed80 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:56.893263 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-0571c572-dc7b-4e91-b061-8c259394ed80 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] [instance: 76efde76-215b-4c32-992f-3fe518470987] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:56.929517 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0571c572-dc7b-4e91-b061-8c259394ed80 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:56.936505 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0571c572-dc7b-4e91-b061-8c259394ed80 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:56.941596 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0571c572-dc7b-4e91-b061-8c259394ed80 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:56.942356 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0571c572-dc7b-4e91-b061-8c259394ed80 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:57.307727 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-0571c572-dc7b-4e91-b061-8c259394ed80 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d2a62272e248d3b11aca8737e22fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e253dfe684b469383c18ff8c2a3dbd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:57.333225 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-0571c572-dc7b-4e91-b061-8c259394ed80 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] 10.222.0.66 "GET /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987" status: 200 len: 1273 microversion: 2.1 time: 0.445076 Jun 22 10:20:57.337905 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 18/36] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:56 2022] GET /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987 => generated 1273 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:20:57.357395 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-3817e577-0045-46f2-866a-2ccb99bd93d7 tempest-VolumesTestJSON-1000861123 tempest-VolumesTestJSON-1000861123-project] Calling method '.version_select at 0x7f60da525160>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:57.703419 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-3817e577-0045-46f2-866a-2ccb99bd93d7 tempest-VolumesTestJSON-1000861123 tempest-VolumesTestJSON-1000861123-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.362066 Jun 22 10:20:57.704031 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 19/37] 10.222.0.66 () {58 vars in 1154 bytes} [Wed Jun 22 10:20:57 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:57.717006 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-c70297aa-393b-4c7a-92b3-89f7e23402d3 tempest-VolumesTestJSON-1000861123 tempest-VolumesTestJSON-1000861123-project] Calling method '.version_select at 0x7f60da4a00d0>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:57.989864 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-c70297aa-393b-4c7a-92b3-89f7e23402d3 tempest-VolumesTestJSON-1000861123 tempest-VolumesTestJSON-1000861123-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.277399 Jun 22 10:20:57.990591 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 20/38] 10.222.0.66 () {58 vars in 1187 bytes} [Wed Jun 22 10:20:57 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:20:58.003456 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-0c284972-5807-47d9-8feb-6f456b6e795e tempest-VolumesTestJSON-1000861123 tempest-VolumesTestJSON-1000861123-project] Calling method '.version_select at 0x7f60da491160>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:58.321301 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-0c284972-5807-47d9-8feb-6f456b6e795e tempest-VolumesTestJSON-1000861123 tempest-VolumesTestJSON-1000861123-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.322034 Jun 22 10:20:58.322216 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 21/39] 10.222.0.66 () {58 vars in 1154 bytes} [Wed Jun 22 10:20:57 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:58.356736 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-0faca306-b780-4ee0-b8d1-7c05c810a78f tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:58.358071 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-0faca306-b780-4ee0-b8d1-7c05c810a78f tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] [instance: 76efde76-215b-4c32-992f-3fe518470987] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:58.372668 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0faca306-b780-4ee0-b8d1-7c05c810a78f tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:58.373934 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0faca306-b780-4ee0-b8d1-7c05c810a78f tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:58.388363 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0faca306-b780-4ee0-b8d1-7c05c810a78f tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:58.389470 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0faca306-b780-4ee0-b8d1-7c05c810a78f tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:58.704344 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-612b489a-8dfb-4378-8bc0-cb2d6469d5a2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Flavor limits 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 10:20:58.705592 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-612b489a-8dfb-4378-8bc0-cb2d6469d5a2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Image limits 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 10:20:58.707245 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-612b489a-8dfb-4378-8bc0-cb2d6469d5a2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Flavor pref 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 10:20:58.707848 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-612b489a-8dfb-4378-8bc0-cb2d6469d5a2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Image pref 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 10:20:58.708432 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-612b489a-8dfb-4378-8bc0-cb2d6469d5a2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 10:20:58.729529 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-612b489a-8dfb-4378-8bc0-cb2d6469d5a2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:58.736929 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-612b489a-8dfb-4378-8bc0-cb2d6469d5a2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:58.738126 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-612b489a-8dfb-4378-8bc0-cb2d6469d5a2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:20:58.739186 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-612b489a-8dfb-4378-8bc0-cb2d6469d5a2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:20:58.799329 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.quota [None req-612b489a-8dfb-4378-8bc0-cb2d6469d5a2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Getting quotas for project 5d4c799515b04fff924caa9819be4faf. Resources: {'instances', 'cores', 'ram'} {{(pid=117680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:20:58.808504 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.quota [None req-612b489a-8dfb-4378-8bc0-cb2d6469d5a2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Getting quotas for user 60dbe36087e14f9e8bf885977b0e7426 and project 5d4c799515b04fff924caa9819be4faf. Resources: {'instances', 'cores', 'ram'} {{(pid=117680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:20:58.829983 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-612b489a-8dfb-4378-8bc0-cb2d6469d5a2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Going to run 1 instances... {{(pid=117680) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 10:20:58.838652 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-612b489a-8dfb-4378-8bc0-cb2d6469d5a2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58addf50-5317-403a-beb0-4760bdbcaa13',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 10:20:59.089464 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-612b489a-8dfb-4378-8bc0-cb2d6469d5a2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 5.392642 Jun 22 10:20:59.090767 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 19/40] 10.222.0.66 () {62 vars in 1187 bytes} [Wed Jun 22 10:20:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 5395 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jun 22 10:20:59.096819 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-fe6706b5-290d-4a06-ab17-0e2a60bd5b8e tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2017799931", "imageRef": "58addf50-5317-403a-beb0-4760bdbcaa13", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8736b376-7b84-42a2-ac98-e61548881245"}], "security_groups": [{"name": "tempest-securitygroup--1951228465"}], "key_name": "tempest-keypair-1166184984", "user_data": "}} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:20:59.146434 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-0faca306-b780-4ee0-b8d1-7c05c810a78f tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d2a62272e248d3b11aca8737e22fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e253dfe684b469383c18ff8c2a3dbd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:59.155650 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-0faca306-b780-4ee0-b8d1-7c05c810a78f tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] 10.222.0.66 "GET /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987" status: 200 len: 1315 microversion: 2.1 time: 0.804675 Jun 22 10:20:59.162536 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 22/41] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:20:58 2022] GET /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987 => generated 1315 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:20:59.193395 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-b9af7cfb-606d-47af-bccd-1c4611a69c48 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:20:59.197717 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-b9af7cfb-606d-47af-bccd-1c4611a69c48 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:20:59.668626 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-b9af7cfb-606d-47af-bccd-1c4611a69c48 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:59.692158 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-b9af7cfb-606d-47af-bccd-1c4611a69c48 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:59.693747 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-b9af7cfb-606d-47af-bccd-1c4611a69c48 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:20:59.712761 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-b9af7cfb-606d-47af-bccd-1c4611a69c48 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1282 microversion: 2.20 time: 0.525082 Jun 22 10:20:59.713740 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 23/42] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:20:59 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1282 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:21:00.323449 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-04741a9a-00f1-4b54-97ff-bda20e3f9d8f tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1384458144", "imageRef": "58addf50-5317-403a-beb0-4760bdbcaa13", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:21:00.402168 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.network.neutron [None req-fe6706b5-290d-4a06-ab17-0e2a60bd5b8e tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] validate_networks() for [('8736b376-7b84-42a2-ac98-e61548881245', None, None, None, None, None)] {{(pid=117680) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 10:21:00.485487 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.network.neutron [None req-04741a9a-00f1-4b54-97ff-bda20e3f9d8f tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] validate_networks() for [('3f9e3af6-d8e5-4494-8a6f-1fa18789963f', None, None, None, None, None)] {{(pid=117679) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 10:21:01.946918 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-fe6706b5-290d-4a06-ab17-0e2a60bd5b8e tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Flavor limits 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 10:21:01.948036 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-fe6706b5-290d-4a06-ab17-0e2a60bd5b8e tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Image limits 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 10:21:01.948686 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-fe6706b5-290d-4a06-ab17-0e2a60bd5b8e tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Flavor pref 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 10:21:01.949525 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-fe6706b5-290d-4a06-ab17-0e2a60bd5b8e tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Image pref 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 10:21:01.950095 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-fe6706b5-290d-4a06-ab17-0e2a60bd5b8e tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 10:21:01.968462 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fe6706b5-290d-4a06-ab17-0e2a60bd5b8e tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:01.970309 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fe6706b5-290d-4a06-ab17-0e2a60bd5b8e tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:01.972536 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fe6706b5-290d-4a06-ab17-0e2a60bd5b8e tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:01.974426 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fe6706b5-290d-4a06-ab17-0e2a60bd5b8e tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:02.022455 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.quota [None req-fe6706b5-290d-4a06-ab17-0e2a60bd5b8e tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Getting quotas for project fecb66f4a7094cd3963caf460c52b88b. Resources: {'instances', 'cores', 'ram'} {{(pid=117680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:21:02.030416 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.quota [None req-fe6706b5-290d-4a06-ab17-0e2a60bd5b8e tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Getting quotas for user 595531abf958489795f2363026697a5b and project fecb66f4a7094cd3963caf460c52b88b. Resources: {'instances', 'cores', 'ram'} {{(pid=117680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:21:02.059868 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-fe6706b5-290d-4a06-ab17-0e2a60bd5b8e tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Going to run 1 instances... {{(pid=117680) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 10:21:02.067087 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-fe6706b5-290d-4a06-ab17-0e2a60bd5b8e tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: da28df11-c078-43d5-81c4-e78ccf9f6504] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58addf50-5317-403a-beb0-4760bdbcaa13',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 10:21:02.255733 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-fe6706b5-290d-4a06-ab17-0e2a60bd5b8e tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.163500 Jun 22 10:21:02.264394 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 20/43] 10.222.0.66 () {60 vars in 1146 bytes} [Wed Jun 22 10:20:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 3173 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 10:21:02.269499 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-ec42704c-0b19-4592-a5aa-8c4e30bd3aab tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:02.270137 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-ec42704c-0b19-4592-a5aa-8c4e30bd3aab tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] [instance: 76efde76-215b-4c32-992f-3fe518470987] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:02.311015 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ec42704c-0b19-4592-a5aa-8c4e30bd3aab tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:02.311479 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ec42704c-0b19-4592-a5aa-8c4e30bd3aab tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:02.312264 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ec42704c-0b19-4592-a5aa-8c4e30bd3aab tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:02.334158 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ec42704c-0b19-4592-a5aa-8c4e30bd3aab tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:02.813189 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-04741a9a-00f1-4b54-97ff-bda20e3f9d8f tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Flavor limits 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 10:21:02.813843 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-04741a9a-00f1-4b54-97ff-bda20e3f9d8f tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Image limits 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 10:21:02.814410 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-04741a9a-00f1-4b54-97ff-bda20e3f9d8f tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Flavor pref 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 10:21:02.815005 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-04741a9a-00f1-4b54-97ff-bda20e3f9d8f tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Image pref 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 10:21:02.815699 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-04741a9a-00f1-4b54-97ff-bda20e3f9d8f tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 10:21:02.818746 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=4 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:02.845718 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-04741a9a-00f1-4b54-97ff-bda20e3f9d8f tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:02.846654 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-04741a9a-00f1-4b54-97ff-bda20e3f9d8f tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:02.847601 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-04741a9a-00f1-4b54-97ff-bda20e3f9d8f tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:02.848052 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-04741a9a-00f1-4b54-97ff-bda20e3f9d8f tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:02.893466 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.quota [None req-04741a9a-00f1-4b54-97ff-bda20e3f9d8f tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Getting quotas for project f20791fa785649cfa5df1f60df84dbdb. Resources: {'instances', 'cores', 'ram'} {{(pid=117679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:21:02.902955 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.quota [None req-04741a9a-00f1-4b54-97ff-bda20e3f9d8f tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Getting quotas for user 8fc916f852f4433eac4a3a2a12384834 and project f20791fa785649cfa5df1f60df84dbdb. Resources: {'instances', 'cores', 'ram'} {{(pid=117679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:21:02.935145 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-04741a9a-00f1-4b54-97ff-bda20e3f9d8f tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Going to run 1 instances... {{(pid=117679) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 10:21:02.943051 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-04741a9a-00f1-4b54-97ff-bda20e3f9d8f tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 739e9dbf-4ccc-4022-83e4-d2f4c36955ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58addf50-5317-403a-beb0-4760bdbcaa13',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 10:21:03.059811 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-04741a9a-00f1-4b54-97ff-bda20e3f9d8f tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.344896 Jun 22 10:21:03.063076 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 24/44] 10.222.0.66 () {60 vars in 1146 bytes} [Wed Jun 22 10:20:59 2022] POST /compute/v2.1/servers => generated 383 bytes in 3349 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 10:21:03.073496 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-1977b8f4-ff15-4e5d-b6e8-3c706f9e9bae tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:03.074407 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-1977b8f4-ff15-4e5d-b6e8-3c706f9e9bae tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:03.092638 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1977b8f4-ff15-4e5d-b6e8-3c706f9e9bae tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:03.094251 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1977b8f4-ff15-4e5d-b6e8-3c706f9e9bae tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:03.095323 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1977b8f4-ff15-4e5d-b6e8-3c706f9e9bae tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:03.095927 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1977b8f4-ff15-4e5d-b6e8-3c706f9e9bae tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:03.386210 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-1977b8f4-ff15-4e5d-b6e8-3c706f9e9bae tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:03.404966 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-1977b8f4-ff15-4e5d-b6e8-3c706f9e9bae tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:03.407656 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-1977b8f4-ff15-4e5d-b6e8-3c706f9e9bae tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:03.412040 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-1977b8f4-ff15-4e5d-b6e8-3c706f9e9bae tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1340 microversion: 2.20 time: 0.347616 Jun 22 10:21:03.419618 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 25/45] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:21:03 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1340 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:21:03.436277 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-b42c331b-2f67-4ec8-bf9f-12f1ef8adc6f tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:03.438726 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-b42c331b-2f67-4ec8-bf9f-12f1ef8adc6f tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: da28df11-c078-43d5-81c4-e78ccf9f6504] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:03.820344 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-b42c331b-2f67-4ec8-bf9f-12f1ef8adc6f tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:03.833167 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-b42c331b-2f67-4ec8-bf9f-12f1ef8adc6f tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504" status: 200 len: 1238 microversion: 2.1 time: 0.411003 Jun 22 10:21:03.834047 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 26/46] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:03 2022] GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504 => generated 1238 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:03.850131 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-51c481ef-c61b-4b9a-ad88-4f92990258bb tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-252322432", "imageRef": "58addf50-5317-403a-beb0-4760bdbcaa13", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "09887ec6-fdf3-4f5d-9b2b-0fe6b3011cfb"}], "security_groups": [{"name": "tempest-securitygroup--949382314"}], "key_name": "tempest-keypair-687818091", "user_data": "}} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:21:03.860474 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-ec42704c-0b19-4592-a5aa-8c4e30bd3aab tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d2a62272e248d3b11aca8737e22fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e253dfe684b469383c18ff8c2a3dbd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:03.890395 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-ec42704c-0b19-4592-a5aa-8c4e30bd3aab tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] 10.222.0.66 "GET /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987" status: 200 len: 1315 microversion: 2.1 time: 1.624675 Jun 22 10:21:03.894801 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 21/47] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:02 2022] GET /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987 => generated 1315 bytes in 1630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:03.905531 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-1f4aa0f9-8bd5-4a7e-8a9e-c92cb756dd96 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:03.927868 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-1f4aa0f9-8bd5-4a7e-8a9e-c92cb756dd96 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 739e9dbf-4ccc-4022-83e4-d2f4c36955ee] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:04.222237 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-1f4aa0f9-8bd5-4a7e-8a9e-c92cb756dd96 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:04.231099 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-1f4aa0f9-8bd5-4a7e-8a9e-c92cb756dd96 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee" status: 200 len: 1222 microversion: 2.1 time: 0.332935 Jun 22 10:21:04.236082 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 22/48] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:03 2022] GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee => generated 1222 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:04.308501 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.network.neutron [None req-51c481ef-c61b-4b9a-ad88-4f92990258bb tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] validate_networks() for [('09887ec6-fdf3-4f5d-9b2b-0fe6b3011cfb', None, None, None, None, None)] {{(pid=117679) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 10:21:05.087307 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-a040e6ca-9f62-459a-9769-628f883e30de req-da381d50-de13-4e2e-be44-7c799014fbcf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76efde76-215b-4c32-992f-3fe518470987", "tag": "2090a85a-6974-46b1-961e-31005ede8287"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:21:05.133666 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-a040e6ca-9f62-459a-9769-628f883e30de req-da381d50-de13-4e2e-be44-7c799014fbcf service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:05.133993 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-a040e6ca-9f62-459a-9769-628f883e30de req-da381d50-de13-4e2e-be44-7c799014fbcf service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:05.224936 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-a040e6ca-9f62-459a-9769-628f883e30de req-da381d50-de13-4e2e-be44-7c799014fbcf service nova] Creating event network-changed:2090a85a-6974-46b1-961e-31005ede8287 for instance 76efde76-215b-4c32-992f-3fe518470987 on hv-cinder-84713 Jun 22 10:21:05.236595 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-a040e6ca-9f62-459a-9769-628f883e30de req-da381d50-de13-4e2e-be44-7c799014fbcf service nova] Acquired lock "compute-rpcapi-router" {{(pid=117680) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 22 10:21:05.240011 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3fd48db2-9a16-4774-a65d-4cc78a676f34 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:05.245413 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3fd48db2-9a16-4774-a65d-4cc78a676f34 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:05.248312 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3fd48db2-9a16-4774-a65d-4cc78a676f34 None None] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:05.249832 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3fd48db2-9a16-4774-a65d-4cc78a676f34 None None] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:05.287500 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.compute.rpcapi [None req-3fd48db2-9a16-4774-a65d-4cc78a676f34 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 22 10:21:05.295992 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3fd48db2-9a16-4774-a65d-4cc78a676f34 None None] Releasing lock "compute-rpcapi-router" {{(pid=117680) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 22 10:21:05.350603 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-3fd48db2-9a16-4774-a65d-4cc78a676f34 None None] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.111125 Jun 22 10:21:05.351539 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 23/49] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:21:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:21:05.357108 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-143a5d12-8cf7-4d33-bc02-4c25095ac18e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:05.369826 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-143a5d12-8cf7-4d33-bc02-4c25095ac18e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:05.388155 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-143a5d12-8cf7-4d33-bc02-4c25095ac18e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:05.394904 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-143a5d12-8cf7-4d33-bc02-4c25095ac18e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:05.396539 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-143a5d12-8cf7-4d33-bc02-4c25095ac18e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:05.399084 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-143a5d12-8cf7-4d33-bc02-4c25095ac18e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:07.709224 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-143a5d12-8cf7-4d33-bc02-4c25095ac18e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:07.722617 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-143a5d12-8cf7-4d33-bc02-4c25095ac18e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:07.729113 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-143a5d12-8cf7-4d33-bc02-4c25095ac18e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:07.738229 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-143a5d12-8cf7-4d33-bc02-4c25095ac18e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1408 microversion: 2.20 time: 2.385258 Jun 22 10:21:07.750170 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 24/50] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:21:05 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1408 bytes in 2397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:21:07.759321 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-8df10789-eae3-46e3-bb00-ba565cf5839a tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:07.771567 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-8df10789-eae3-46e3-bb00-ba565cf5839a tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: da28df11-c078-43d5-81c4-e78ccf9f6504] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:07.779175 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8df10789-eae3-46e3-bb00-ba565cf5839a tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:07.780043 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8df10789-eae3-46e3-bb00-ba565cf5839a tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:07.781431 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8df10789-eae3-46e3-bb00-ba565cf5839a tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:07.782018 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8df10789-eae3-46e3-bb00-ba565cf5839a tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:08.209518 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-8df10789-eae3-46e3-bb00-ba565cf5839a tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:08.223036 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-8df10789-eae3-46e3-bb00-ba565cf5839a tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504" status: 200 len: 1296 microversion: 2.1 time: 0.471452 Jun 22 10:21:08.233506 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 25/51] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:07 2022] GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504 => generated 1296 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:08.242013 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-57310fd1-fbb1-4436-87dd-b23dd5f720a4 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1275082225", "imageRef": "58addf50-5317-403a-beb0-4760bdbcaa13", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:21:08.413968 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.network.neutron [None req-57310fd1-fbb1-4436-87dd-b23dd5f720a4 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] validate_networks() for [('3f9e3af6-d8e5-4494-8a6f-1fa18789963f', None, None, None, None, None)] {{(pid=117680) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 10:21:08.511690 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-51c481ef-c61b-4b9a-ad88-4f92990258bb tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Flavor limits 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 10:21:08.512777 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-51c481ef-c61b-4b9a-ad88-4f92990258bb tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Image limits 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 10:21:08.513442 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-51c481ef-c61b-4b9a-ad88-4f92990258bb tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Flavor pref 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 10:21:08.514005 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-51c481ef-c61b-4b9a-ad88-4f92990258bb tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Image pref 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 10:21:08.514590 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-51c481ef-c61b-4b9a-ad88-4f92990258bb tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 10:21:08.542357 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-51c481ef-c61b-4b9a-ad88-4f92990258bb tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:08.542994 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-51c481ef-c61b-4b9a-ad88-4f92990258bb tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:08.543951 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-51c481ef-c61b-4b9a-ad88-4f92990258bb tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:08.544563 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-51c481ef-c61b-4b9a-ad88-4f92990258bb tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:08.605040 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.quota [None req-51c481ef-c61b-4b9a-ad88-4f92990258bb tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Getting quotas for project 1db3fe97f51f47a98da3cbc8f0d55741. Resources: {'instances', 'cores', 'ram'} {{(pid=117679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:21:08.611245 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.quota [None req-51c481ef-c61b-4b9a-ad88-4f92990258bb tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Getting quotas for user da80b9a52feb462faf0469f2ab701fb8 and project 1db3fe97f51f47a98da3cbc8f0d55741. Resources: {'instances', 'cores', 'ram'} {{(pid=117679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:21:08.640970 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-51c481ef-c61b-4b9a-ad88-4f92990258bb tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Going to run 1 instances... {{(pid=117679) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 10:21:08.643470 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-51c481ef-c61b-4b9a-ad88-4f92990258bb tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: c9505087-b458-46dc-9fbb-ee4ef61decde] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58addf50-5317-403a-beb0-4760bdbcaa13',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 10:21:08.759830 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-51c481ef-c61b-4b9a-ad88-4f92990258bb tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.924404 Jun 22 10:21:08.760496 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 27/52] 10.222.0.66 () {60 vars in 1146 bytes} [Wed Jun 22 10:21:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 4926 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 10:21:08.765375 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-7d28b647-c258-468f-8f02-822ce7b4b7c7 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:08.794437 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-7d28b647-c258-468f-8f02-822ce7b4b7c7 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] [instance: 76efde76-215b-4c32-992f-3fe518470987] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:08.827201 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7d28b647-c258-468f-8f02-822ce7b4b7c7 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:08.827201 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7d28b647-c258-468f-8f02-822ce7b4b7c7 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:08.827201 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7d28b647-c258-468f-8f02-822ce7b4b7c7 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:08.827201 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7d28b647-c258-468f-8f02-822ce7b4b7c7 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:11.135167 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-7d28b647-c258-468f-8f02-822ce7b4b7c7 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d2a62272e248d3b11aca8737e22fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e253dfe684b469383c18ff8c2a3dbd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:11.158077 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-7d28b647-c258-468f-8f02-822ce7b4b7c7 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] 10.222.0.66 "GET /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987" status: 200 len: 1315 microversion: 2.1 time: 2.396257 Jun 22 10:21:11.160647 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 28/53] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:08 2022] GET /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987 => generated 1315 bytes in 2399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:11.178683 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-fba80bd4-34e5-410e-b8b2-f0566da53304 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:11.182674 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-fba80bd4-34e5-410e-b8b2-f0566da53304 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:11.195779 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-fba80bd4-34e5-410e-b8b2-f0566da53304 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:11.199811 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-fba80bd4-34e5-410e-b8b2-f0566da53304 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:11.200973 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-fba80bd4-34e5-410e-b8b2-f0566da53304 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:11.201586 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-fba80bd4-34e5-410e-b8b2-f0566da53304 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:11.253810 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_cell1:SELECT=61 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:12.672861 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-fba80bd4-34e5-410e-b8b2-f0566da53304 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:12.685627 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-fba80bd4-34e5-410e-b8b2-f0566da53304 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:12.691326 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-fba80bd4-34e5-410e-b8b2-f0566da53304 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:12.693394 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-fba80bd4-34e5-410e-b8b2-f0566da53304 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1408 microversion: 2.20 time: 1.531031 Jun 22 10:21:12.695802 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 29/54] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:21:11 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1408 bytes in 1534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:21:12.709766 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-15eaad75-9f04-4c2a-b37e-d4f95b6c8f9a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:12.710487 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-15eaad75-9f04-4c2a-b37e-d4f95b6c8f9a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: c9505087-b458-46dc-9fbb-ee4ef61decde] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:12.722083 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-15eaad75-9f04-4c2a-b37e-d4f95b6c8f9a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:12.723240 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-15eaad75-9f04-4c2a-b37e-d4f95b6c8f9a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:12.737399 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-15eaad75-9f04-4c2a-b37e-d4f95b6c8f9a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:12.737399 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-15eaad75-9f04-4c2a-b37e-d4f95b6c8f9a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:12.943418 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-15eaad75-9f04-4c2a-b37e-d4f95b6c8f9a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:12.952921 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-15eaad75-9f04-4c2a-b37e-d4f95b6c8f9a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde" status: 200 len: 1292 microversion: 2.1 time: 0.255338 Jun 22 10:21:12.953522 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 30/55] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:12 2022] GET /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde => generated 1292 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:12.967930 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-fac516a7-a8c3-485b-b164-16218415bab0 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:12.969220 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-fac516a7-a8c3-485b-b164-16218415bab0 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: da28df11-c078-43d5-81c4-e78ccf9f6504] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:12.983882 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-fac516a7-a8c3-485b-b164-16218415bab0 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:12.985880 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-fac516a7-a8c3-485b-b164-16218415bab0 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:12.988661 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-fac516a7-a8c3-485b-b164-16218415bab0 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:12.989252 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-fac516a7-a8c3-485b-b164-16218415bab0 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:13.027892 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-57310fd1-fbb1-4436-87dd-b23dd5f720a4 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Flavor limits 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 10:21:13.028401 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-57310fd1-fbb1-4436-87dd-b23dd5f720a4 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Image limits 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 10:21:13.028783 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-57310fd1-fbb1-4436-87dd-b23dd5f720a4 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Flavor pref 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 10:21:13.029199 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-57310fd1-fbb1-4436-87dd-b23dd5f720a4 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Image pref 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 10:21:13.029623 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-57310fd1-fbb1-4436-87dd-b23dd5f720a4 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 10:21:13.048073 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-57310fd1-fbb1-4436-87dd-b23dd5f720a4 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:13.048542 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-57310fd1-fbb1-4436-87dd-b23dd5f720a4 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:13.049685 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-57310fd1-fbb1-4436-87dd-b23dd5f720a4 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:13.050140 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-57310fd1-fbb1-4436-87dd-b23dd5f720a4 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:13.086299 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.quota [None req-57310fd1-fbb1-4436-87dd-b23dd5f720a4 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Getting quotas for project f20791fa785649cfa5df1f60df84dbdb. Resources: {'instances', 'cores', 'ram'} {{(pid=117680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:21:13.091489 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.quota [None req-57310fd1-fbb1-4436-87dd-b23dd5f720a4 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Getting quotas for user 8fc916f852f4433eac4a3a2a12384834 and project f20791fa785649cfa5df1f60df84dbdb. Resources: {'instances', 'cores', 'ram'} {{(pid=117680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:21:13.104884 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-57310fd1-fbb1-4436-87dd-b23dd5f720a4 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Going to run 1 instances... {{(pid=117680) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 10:21:13.107666 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-57310fd1-fbb1-4436-87dd-b23dd5f720a4 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58addf50-5317-403a-beb0-4760bdbcaa13',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 10:21:13.208835 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-57310fd1-fbb1-4436-87dd-b23dd5f720a4 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.981995 Jun 22 10:21:13.222675 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 26/56] 10.222.0.66 () {60 vars in 1146 bytes} [Wed Jun 22 10:21:08 2022] POST /compute/v2.1/servers => generated 383 bytes in 4997 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 10:21:13.227985 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-b04a72f9-8087-4619-b7db-c6685f71d395 req-1b680bf2-b6e3-480a-b672-20795e80a43f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "755c0b10-e04a-42fa-86da-8cc65537315d", "tag": "2931da67-7e8b-43c4-9fbb-3adba1b7225a"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:21:13.255971 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-b04a72f9-8087-4619-b7db-c6685f71d395 req-1b680bf2-b6e3-480a-b672-20795e80a43f service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:13.260402 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-b04a72f9-8087-4619-b7db-c6685f71d395 req-1b680bf2-b6e3-480a-b672-20795e80a43f service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:13.269542 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-fac516a7-a8c3-485b-b164-16218415bab0 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:13.285901 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-b04a72f9-8087-4619-b7db-c6685f71d395 req-1b680bf2-b6e3-480a-b672-20795e80a43f service nova] Creating event network-changed:2931da67-7e8b-43c4-9fbb-3adba1b7225a for instance 755c0b10-e04a-42fa-86da-8cc65537315d on hv-cinder-84713 Jun 22 10:21:13.286661 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-fac516a7-a8c3-485b-b164-16218415bab0 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504" status: 200 len: 1364 microversion: 2.1 time: 0.327884 Jun 22 10:21:13.292271 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-b04a72f9-8087-4619-b7db-c6685f71d395 req-1b680bf2-b6e3-480a-b672-20795e80a43f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068256 Jun 22 10:21:13.294182 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 27/57] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:21:13.297275 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 31/58] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:12 2022] GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504 => generated 1364 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:13.308965 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-59d76a58-f2c8-486f-904f-b5fdbe9f87e2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:13.309391 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-59d76a58-f2c8-486f-904f-b5fdbe9f87e2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:13.313573 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-79114898-6a7b-4901-944b-5d7729055ccb tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:13.314348 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-79114898-6a7b-4901-944b-5d7729055ccb tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] [instance: 76efde76-215b-4c32-992f-3fe518470987] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:13.319930 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:13.338652 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-79114898-6a7b-4901-944b-5d7729055ccb tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:13.368795 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-79114898-6a7b-4901-944b-5d7729055ccb tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:13.374306 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-79114898-6a7b-4901-944b-5d7729055ccb tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:13.377569 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-79114898-6a7b-4901-944b-5d7729055ccb tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:13.383613 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-59d76a58-f2c8-486f-904f-b5fdbe9f87e2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:13.392304 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-59d76a58-f2c8-486f-904f-b5fdbe9f87e2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1222 microversion: 2.1 time: 0.093829 Jun 22 10:21:13.392900 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 32/59] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:13 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1222 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:13.644904 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-79114898-6a7b-4901-944b-5d7729055ccb tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d2a62272e248d3b11aca8737e22fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e253dfe684b469383c18ff8c2a3dbd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:13.681735 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-79114898-6a7b-4901-944b-5d7729055ccb tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] 10.222.0.66 "GET /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987" status: 200 len: 1315 microversion: 2.1 time: 0.382480 Jun 22 10:21:13.681735 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 28/60] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:13 2022] GET /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987 => generated 1315 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:13.716228 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-369168bc-6d64-47e5-a891-c14382260f36 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:13.717874 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-369168bc-6d64-47e5-a891-c14382260f36 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:13.734399 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-369168bc-6d64-47e5-a891-c14382260f36 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:13.735910 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-369168bc-6d64-47e5-a891-c14382260f36 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:13.738446 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-369168bc-6d64-47e5-a891-c14382260f36 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:13.739821 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-369168bc-6d64-47e5-a891-c14382260f36 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:13.971129 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-916ea6d7-e125-44f8-8780-99a25b7d989d tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:13.971981 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-916ea6d7-e125-44f8-8780-99a25b7d989d tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: c9505087-b458-46dc-9fbb-ee4ef61decde] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:13.983984 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-916ea6d7-e125-44f8-8780-99a25b7d989d tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:13.986859 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-916ea6d7-e125-44f8-8780-99a25b7d989d tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:13.988932 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-916ea6d7-e125-44f8-8780-99a25b7d989d tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:13.991955 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-916ea6d7-e125-44f8-8780-99a25b7d989d tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:14.018061 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-369168bc-6d64-47e5-a891-c14382260f36 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:14.028123 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-369168bc-6d64-47e5-a891-c14382260f36 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:14.029642 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-369168bc-6d64-47e5-a891-c14382260f36 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:14.031271 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-369168bc-6d64-47e5-a891-c14382260f36 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1408 microversion: 2.20 time: 0.321326 Jun 22 10:21:14.042258 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 33/61] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:21:13 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1408 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:21:14.091281 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-916ea6d7-e125-44f8-8780-99a25b7d989d tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:14.113416 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-916ea6d7-e125-44f8-8780-99a25b7d989d tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde" status: 200 len: 1292 microversion: 2.1 time: 0.147272 Jun 22 10:21:14.114486 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 29/62] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:13 2022] GET /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde => generated 1292 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:14.304736 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-1252740f-8e18-4dfa-8e4a-59a4eb267478 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:14.305714 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-1252740f-8e18-4dfa-8e4a-59a4eb267478 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: da28df11-c078-43d5-81c4-e78ccf9f6504] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:14.313082 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1252740f-8e18-4dfa-8e4a-59a4eb267478 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:14.313787 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1252740f-8e18-4dfa-8e4a-59a4eb267478 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:14.314734 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1252740f-8e18-4dfa-8e4a-59a4eb267478 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:14.315362 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1252740f-8e18-4dfa-8e4a-59a4eb267478 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:14.413942 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-4cb3b517-6947-443b-a3c5-c10e89b6c6ac tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:14.414705 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-4cb3b517-6947-443b-a3c5-c10e89b6c6ac tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:14.423423 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4cb3b517-6947-443b-a3c5-c10e89b6c6ac tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:14.424040 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4cb3b517-6947-443b-a3c5-c10e89b6c6ac tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:14.425168 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4cb3b517-6947-443b-a3c5-c10e89b6c6ac tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:14.426160 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4cb3b517-6947-443b-a3c5-c10e89b6c6ac tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:14.525156 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-4cb3b517-6947-443b-a3c5-c10e89b6c6ac tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:14.536802 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-4cb3b517-6947-443b-a3c5-c10e89b6c6ac tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1226 microversion: 2.1 time: 0.129922 Jun 22 10:21:14.542254 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 30/63] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:14 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1226 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:14.544212 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-1252740f-8e18-4dfa-8e4a-59a4eb267478 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:14.569059 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-1252740f-8e18-4dfa-8e4a-59a4eb267478 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504" status: 200 len: 1364 microversion: 2.1 time: 0.266357 Jun 22 10:21:14.586063 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 34/64] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:14 2022] GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504 => generated 1364 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:14.695577 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-cdc12833-4911-4eb4-8539-7b8d1ddb97cc tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:14.696184 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-cdc12833-4911-4eb4-8539-7b8d1ddb97cc tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] [instance: 76efde76-215b-4c32-992f-3fe518470987] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:14.711431 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-cdc12833-4911-4eb4-8539-7b8d1ddb97cc tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:14.711995 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-cdc12833-4911-4eb4-8539-7b8d1ddb97cc tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:14.713026 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-cdc12833-4911-4eb4-8539-7b8d1ddb97cc tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:14.713472 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-cdc12833-4911-4eb4-8539-7b8d1ddb97cc tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:15.049737 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-33d05767-1834-41a9-b853-47cd3bed1b08 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:15.050346 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-33d05767-1834-41a9-b853-47cd3bed1b08 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:15.067706 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-33d05767-1834-41a9-b853-47cd3bed1b08 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:15.068329 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-33d05767-1834-41a9-b853-47cd3bed1b08 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:15.069269 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-33d05767-1834-41a9-b853-47cd3bed1b08 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:15.069841 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-33d05767-1834-41a9-b853-47cd3bed1b08 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:15.442666 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-cdc12833-4911-4eb4-8539-7b8d1ddb97cc tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d2a62272e248d3b11aca8737e22fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e253dfe684b469383c18ff8c2a3dbd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:15.451977 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-cdc12833-4911-4eb4-8539-7b8d1ddb97cc tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] 10.222.0.66 "GET /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987" status: 200 len: 1315 microversion: 2.1 time: 0.761125 Jun 22 10:21:15.452568 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 31/65] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:14 2022] GET /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987 => generated 1315 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:15.469709 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-9d704d13-6220-4c6e-b223-680793596f6a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:15.470450 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-9d704d13-6220-4c6e-b223-680793596f6a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: c9505087-b458-46dc-9fbb-ee4ef61decde] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:15.488069 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9d704d13-6220-4c6e-b223-680793596f6a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:15.489845 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9d704d13-6220-4c6e-b223-680793596f6a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:15.498842 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9d704d13-6220-4c6e-b223-680793596f6a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:15.499918 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9d704d13-6220-4c6e-b223-680793596f6a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:15.754991 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-9d704d13-6220-4c6e-b223-680793596f6a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:15.770592 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-9d704d13-6220-4c6e-b223-680793596f6a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde" status: 200 len: 1298 microversion: 2.1 time: 0.314497 Jun 22 10:21:15.771647 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 32/66] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:15 2022] GET /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde => generated 1298 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:15.787358 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-6e46626d-b1e7-4314-a8ca-842de4a6830d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:15.788375 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-6e46626d-b1e7-4314-a8ca-842de4a6830d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:15.795034 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6e46626d-b1e7-4314-a8ca-842de4a6830d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:15.795734 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6e46626d-b1e7-4314-a8ca-842de4a6830d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:15.809574 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-33d05767-1834-41a9-b853-47cd3bed1b08 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:15.814292 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6e46626d-b1e7-4314-a8ca-842de4a6830d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:15.820525 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6e46626d-b1e7-4314-a8ca-842de4a6830d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:15.823213 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-33d05767-1834-41a9-b853-47cd3bed1b08 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:15.825203 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-33d05767-1834-41a9-b853-47cd3bed1b08 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:15.829049 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-33d05767-1834-41a9-b853-47cd3bed1b08 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1408 microversion: 2.20 time: 0.783516 Jun 22 10:21:15.831635 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 35/67] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:21:15 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1408 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:21:15.836591 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-1fb20673-f4d9-4ecb-a74f-dcf0e5005acb tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:15.844505 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-1fb20673-f4d9-4ecb-a74f-dcf0e5005acb tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: da28df11-c078-43d5-81c4-e78ccf9f6504] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:15.859364 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1fb20673-f4d9-4ecb-a74f-dcf0e5005acb tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:15.860148 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1fb20673-f4d9-4ecb-a74f-dcf0e5005acb tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:15.863331 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1fb20673-f4d9-4ecb-a74f-dcf0e5005acb tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:15.865624 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1fb20673-f4d9-4ecb-a74f-dcf0e5005acb tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:16.060175 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-6e46626d-b1e7-4314-a8ca-842de4a6830d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:16.077257 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-6e46626d-b1e7-4314-a8ca-842de4a6830d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1282 microversion: 2.1 time: 0.292155 Jun 22 10:21:16.079609 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 33/68] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:15 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1282 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:16.193212 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-1fb20673-f4d9-4ecb-a74f-dcf0e5005acb tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:16.204809 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-1fb20673-f4d9-4ecb-a74f-dcf0e5005acb tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504" status: 200 len: 1364 microversion: 2.1 time: 0.371895 Jun 22 10:21:16.205743 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 36/69] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:15 2022] GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504 => generated 1364 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:16.470239 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-1129fe2e-1933-4770-a5b7-6457ae5375e3 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:16.471134 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-1129fe2e-1933-4770-a5b7-6457ae5375e3 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] [instance: 76efde76-215b-4c32-992f-3fe518470987] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:16.491459 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1129fe2e-1933-4770-a5b7-6457ae5375e3 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:16.493451 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1129fe2e-1933-4770-a5b7-6457ae5375e3 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:16.507858 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1129fe2e-1933-4770-a5b7-6457ae5375e3 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:16.509609 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1129fe2e-1933-4770-a5b7-6457ae5375e3 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:16.790088 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-730d8e6c-b25e-4fbb-acae-4598f57feac4 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:16.790910 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-730d8e6c-b25e-4fbb-acae-4598f57feac4 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: c9505087-b458-46dc-9fbb-ee4ef61decde] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:16.803546 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-730d8e6c-b25e-4fbb-acae-4598f57feac4 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:16.804345 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-730d8e6c-b25e-4fbb-acae-4598f57feac4 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:16.805445 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-730d8e6c-b25e-4fbb-acae-4598f57feac4 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:16.811281 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-730d8e6c-b25e-4fbb-acae-4598f57feac4 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:17.273625 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-1129fe2e-1933-4770-a5b7-6457ae5375e3 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d2a62272e248d3b11aca8737e22fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e253dfe684b469383c18ff8c2a3dbd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:17.286105 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-1129fe2e-1933-4770-a5b7-6457ae5375e3 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] 10.222.0.66 "GET /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987" status: 200 len: 1315 microversion: 2.1 time: 0.820523 Jun 22 10:21:17.288493 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 34/70] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:16 2022] GET /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987 => generated 1315 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:17.296936 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-2b508a18-309d-440c-9f55-73f8deffecf6 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:17.298248 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-2b508a18-309d-440c-9f55-73f8deffecf6 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:17.311211 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2b508a18-309d-440c-9f55-73f8deffecf6 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:17.314669 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2b508a18-309d-440c-9f55-73f8deffecf6 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:17.316378 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2b508a18-309d-440c-9f55-73f8deffecf6 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:17.317117 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2b508a18-309d-440c-9f55-73f8deffecf6 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:17.427811 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-730d8e6c-b25e-4fbb-acae-4598f57feac4 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:17.437725 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-730d8e6c-b25e-4fbb-acae-4598f57feac4 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde" status: 200 len: 1365 microversion: 2.1 time: 0.652543 Jun 22 10:21:17.441565 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 37/71] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:16 2022] GET /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde => generated 1365 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:21:17.446466 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-901cf73d-c4f5-4b79-bfdf-b7727469f78e tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:17.447119 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-901cf73d-c4f5-4b79-bfdf-b7727469f78e tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:17.468627 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-901cf73d-c4f5-4b79-bfdf-b7727469f78e tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:17.469288 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-901cf73d-c4f5-4b79-bfdf-b7727469f78e tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:17.470242 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-901cf73d-c4f5-4b79-bfdf-b7727469f78e tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:17.470817 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-901cf73d-c4f5-4b79-bfdf-b7727469f78e tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:17.630924 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-901cf73d-c4f5-4b79-bfdf-b7727469f78e tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:17.646901 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-901cf73d-c4f5-4b79-bfdf-b7727469f78e tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1282 microversion: 2.1 time: 0.204154 Jun 22 10:21:17.648013 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 38/72] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:17 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1282 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:17.652891 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-9f137673-5103-41ae-b277-1474165fb720 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:17.653498 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-9f137673-5103-41ae-b277-1474165fb720 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: da28df11-c078-43d5-81c4-e78ccf9f6504] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:17.664055 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9f137673-5103-41ae-b277-1474165fb720 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:17.664679 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9f137673-5103-41ae-b277-1474165fb720 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:17.666528 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9f137673-5103-41ae-b277-1474165fb720 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:17.667113 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9f137673-5103-41ae-b277-1474165fb720 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:17.985622 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-2b508a18-309d-440c-9f55-73f8deffecf6 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:18.004010 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-2b508a18-309d-440c-9f55-73f8deffecf6 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:18.005856 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-2b508a18-309d-440c-9f55-73f8deffecf6 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:18.007535 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-2b508a18-309d-440c-9f55-73f8deffecf6 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1408 microversion: 2.20 time: 0.717228 Jun 22 10:21:18.008813 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 35/73] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:21:17 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1408 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:21:18.304286 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-14b7a748-f261-45c6-9e1d-98e1b4f0473a tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:18.305144 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-14b7a748-f261-45c6-9e1d-98e1b4f0473a tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] [instance: 76efde76-215b-4c32-992f-3fe518470987] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:18.314327 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-14b7a748-f261-45c6-9e1d-98e1b4f0473a tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:18.320567 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-14b7a748-f261-45c6-9e1d-98e1b4f0473a tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:18.323823 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-14b7a748-f261-45c6-9e1d-98e1b4f0473a tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:18.324379 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-14b7a748-f261-45c6-9e1d-98e1b4f0473a tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:18.576644 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_cell0:SELECT=4 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:18.703711 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-9f137673-5103-41ae-b277-1474165fb720 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:18.716185 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-9f137673-5103-41ae-b277-1474165fb720 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504" status: 200 len: 1364 microversion: 2.1 time: 1.065425 Jun 22 10:21:18.717059 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 39/74] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:17 2022] GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504 => generated 1364 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:18.723568 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-920656a2-f31a-466f-a2a5-c8ca828fe3c1 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:18.724590 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-920656a2-f31a-466f-a2a5-c8ca828fe3c1 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: c9505087-b458-46dc-9fbb-ee4ef61decde] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:18.738743 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-920656a2-f31a-466f-a2a5-c8ca828fe3c1 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:18.739567 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-920656a2-f31a-466f-a2a5-c8ca828fe3c1 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:18.741246 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-920656a2-f31a-466f-a2a5-c8ca828fe3c1 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:18.741947 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-920656a2-f31a-466f-a2a5-c8ca828fe3c1 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:19.188791 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-14b7a748-f261-45c6-9e1d-98e1b4f0473a tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d2a62272e248d3b11aca8737e22fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e253dfe684b469383c18ff8c2a3dbd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:19.198090 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-14b7a748-f261-45c6-9e1d-98e1b4f0473a tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] 10.222.0.66 "GET /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987" status: 200 len: 1315 microversion: 2.1 time: 0.897555 Jun 22 10:21:19.199106 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 36/75] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:18 2022] GET /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987 => generated 1315 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:21:19.283332 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-bad52515-4eba-499c-b9fb-67d8fd6ce74b req-5f4f1c23-3eac-42b0-be7c-461689f34bdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "739e9dbf-4ccc-4022-83e4-d2f4c36955ee", "tag": "66ed55a7-8e67-4d46-9b13-c7875b6be0f5"}, {"name": "network-changed", "server_uuid": "da28df11-c078-43d5-81c4-e78ccf9f6504", "tag": "937e9931-d784-4d24-8619-009399b6a8d5"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:21:19.298139 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-bad52515-4eba-499c-b9fb-67d8fd6ce74b req-5f4f1c23-3eac-42b0-be7c-461689f34bdd service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:19.299917 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-bad52515-4eba-499c-b9fb-67d8fd6ce74b req-5f4f1c23-3eac-42b0-be7c-461689f34bdd service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:19.322525 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-bad52515-4eba-499c-b9fb-67d8fd6ce74b req-5f4f1c23-3eac-42b0-be7c-461689f34bdd service nova] Creating event network-changed:66ed55a7-8e67-4d46-9b13-c7875b6be0f5 for instance 739e9dbf-4ccc-4022-83e4-d2f4c36955ee on hv-cinder-84713 Jun 22 10:21:19.323357 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-bad52515-4eba-499c-b9fb-67d8fd6ce74b req-5f4f1c23-3eac-42b0-be7c-461689f34bdd service nova] Creating event network-changed:937e9931-d784-4d24-8619-009399b6a8d5 for instance da28df11-c078-43d5-81c4-e78ccf9f6504 on hv-cinder-84713 Jun 22 10:21:19.332614 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-bad52515-4eba-499c-b9fb-67d8fd6ce74b req-5f4f1c23-3eac-42b0-be7c-461689f34bdd service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.131808 Jun 22 10:21:19.333844 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 37/76] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:21:19.341806 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-83e18f93-7fd8-4cac-b1e5-136ddbe1c84f tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:19.342477 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-83e18f93-7fd8-4cac-b1e5-136ddbe1c84f tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:19.350314 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-83e18f93-7fd8-4cac-b1e5-136ddbe1c84f tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:19.351011 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-83e18f93-7fd8-4cac-b1e5-136ddbe1c84f tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:19.351971 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-83e18f93-7fd8-4cac-b1e5-136ddbe1c84f tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:19.352744 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-83e18f93-7fd8-4cac-b1e5-136ddbe1c84f tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:19.478740 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-920656a2-f31a-466f-a2a5-c8ca828fe3c1 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:19.491000 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-920656a2-f31a-466f-a2a5-c8ca828fe3c1 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde" status: 200 len: 1365 microversion: 2.1 time: 0.771228 Jun 22 10:21:19.491599 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 40/77] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:18 2022] GET /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde => generated 1365 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:19.534925 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-83e18f93-7fd8-4cac-b1e5-136ddbe1c84f tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:19.545176 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-83e18f93-7fd8-4cac-b1e5-136ddbe1c84f tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1280 microversion: 2.1 time: 0.209660 Jun 22 10:21:19.551851 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 38/78] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:19 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1280 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:19.560215 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-374d77e9-8d69-4588-b7cb-89e8f31260de tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:19.563090 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-374d77e9-8d69-4588-b7cb-89e8f31260de tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:19.581075 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-374d77e9-8d69-4588-b7cb-89e8f31260de tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:19.585570 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-374d77e9-8d69-4588-b7cb-89e8f31260de tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:19.590287 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-374d77e9-8d69-4588-b7cb-89e8f31260de tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:19.592503 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-374d77e9-8d69-4588-b7cb-89e8f31260de tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:19.811789 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-23e1f3d5-d3b8-497a-9c5f-0a2f3ff79b32 req-d93f922d-ba66-4177-9034-5a30f4b3055b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76efde76-215b-4c32-992f-3fe518470987", "name": "network-vif-plugged", "status": "completed", "tag": "2090a85a-6974-46b1-961e-31005ede8287"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:21:19.827385 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-23e1f3d5-d3b8-497a-9c5f-0a2f3ff79b32 req-d93f922d-ba66-4177-9034-5a30f4b3055b service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:19.828068 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-23e1f3d5-d3b8-497a-9c5f-0a2f3ff79b32 req-d93f922d-ba66-4177-9034-5a30f4b3055b service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:19.858004 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-23e1f3d5-d3b8-497a-9c5f-0a2f3ff79b32 req-d93f922d-ba66-4177-9034-5a30f4b3055b service nova] Creating event network-vif-plugged:2090a85a-6974-46b1-961e-31005ede8287 for instance 76efde76-215b-4c32-992f-3fe518470987 on hv-cinder-84713 Jun 22 10:21:19.859546 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-23e1f3d5-d3b8-497a-9c5f-0a2f3ff79b32 req-d93f922d-ba66-4177-9034-5a30f4b3055b service nova] Acquired lock "compute-rpcapi-router" {{(pid=117679) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 22 10:21:19.860956 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-cd523de4-6f66-42a0-9300-d085328cf06a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:19.861766 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-cd523de4-6f66-42a0-9300-d085328cf06a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:19.862782 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-cd523de4-6f66-42a0-9300-d085328cf06a None None] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:19.863963 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-cd523de4-6f66-42a0-9300-d085328cf06a None None] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:19.878436 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.compute.rpcapi [None req-cd523de4-6f66-42a0-9300-d085328cf06a None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 22 10:21:19.879992 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-cd523de4-6f66-42a0-9300-d085328cf06a None None] Releasing lock "compute-rpcapi-router" {{(pid=117679) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 22 10:21:19.905397 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-cd523de4-6f66-42a0-9300-d085328cf06a None None] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.412558 Jun 22 10:21:19.907551 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 41/79] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:21:19.914113 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-e9c4d1de-ef59-42cb-8d47-86f4d62b5d4e tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:19.915136 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-e9c4d1de-ef59-42cb-8d47-86f4d62b5d4e tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: da28df11-c078-43d5-81c4-e78ccf9f6504] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:19.924351 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e9c4d1de-ef59-42cb-8d47-86f4d62b5d4e tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:19.925543 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e9c4d1de-ef59-42cb-8d47-86f4d62b5d4e tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:19.926360 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e9c4d1de-ef59-42cb-8d47-86f4d62b5d4e tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:19.926845 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e9c4d1de-ef59-42cb-8d47-86f4d62b5d4e tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:20.049544 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-374d77e9-8d69-4588-b7cb-89e8f31260de tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:20.059939 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-374d77e9-8d69-4588-b7cb-89e8f31260de tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:20.068670 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-374d77e9-8d69-4588-b7cb-89e8f31260de tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:20.070370 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-374d77e9-8d69-4588-b7cb-89e8f31260de tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1408 microversion: 2.20 time: 0.517067 Jun 22 10:21:20.071246 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 39/80] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:21:19 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1408 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:21:20.077090 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-da14f294-0b85-4735-a740-74d4eaeb2de6 req-4daed83f-bbc1-442f-a731-f7714e9350cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9505087-b458-46dc-9fbb-ee4ef61decde", "tag": "2527809f-dcc9-4a6b-88ec-69d974d132c2"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:21:20.089032 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-da14f294-0b85-4735-a740-74d4eaeb2de6 req-4daed83f-bbc1-442f-a731-f7714e9350cd service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:20.089734 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-da14f294-0b85-4735-a740-74d4eaeb2de6 req-4daed83f-bbc1-442f-a731-f7714e9350cd service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:20.095569 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:SELECT=100 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:20.106644 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-da14f294-0b85-4735-a740-74d4eaeb2de6 req-4daed83f-bbc1-442f-a731-f7714e9350cd service nova] Creating event network-changed:2527809f-dcc9-4a6b-88ec-69d974d132c2 for instance c9505087-b458-46dc-9fbb-ee4ef61decde on hv-cinder-84713 Jun 22 10:21:20.112416 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-da14f294-0b85-4735-a740-74d4eaeb2de6 req-4daed83f-bbc1-442f-a731-f7714e9350cd service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039211 Jun 22 10:21:20.113893 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 40/81] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:21:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:21:20.200936 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-e9c4d1de-ef59-42cb-8d47-86f4d62b5d4e tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:20.214706 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-e9c4d1de-ef59-42cb-8d47-86f4d62b5d4e tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504" status: 200 len: 1364 microversion: 2.1 time: 0.301304 Jun 22 10:21:20.215394 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 42/82] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:19 2022] GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504 => generated 1364 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:20.217470 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-19de9573-92eb-4c50-9c52-d72e3123c8a0 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:20.218215 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-19de9573-92eb-4c50-9c52-d72e3123c8a0 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] [instance: 76efde76-215b-4c32-992f-3fe518470987] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:20.233412 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-19de9573-92eb-4c50-9c52-d72e3123c8a0 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:20.233757 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-19de9573-92eb-4c50-9c52-d72e3123c8a0 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:20.234578 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-19de9573-92eb-4c50-9c52-d72e3123c8a0 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:20.235070 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-19de9573-92eb-4c50-9c52-d72e3123c8a0 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:20.457273 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-19de9573-92eb-4c50-9c52-d72e3123c8a0 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d2a62272e248d3b11aca8737e22fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e253dfe684b469383c18ff8c2a3dbd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:20.467102 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-19de9573-92eb-4c50-9c52-d72e3123c8a0 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] 10.222.0.66 "GET /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987" status: 200 len: 1315 microversion: 2.1 time: 0.254973 Jun 22 10:21:20.477809 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 41/83] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:20 2022] GET /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987 => generated 1315 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:20.508384 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-9da0fa54-26e1-49fd-8f27-9228f01eec38 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:20.509614 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-9da0fa54-26e1-49fd-8f27-9228f01eec38 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: c9505087-b458-46dc-9fbb-ee4ef61decde] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:20.516985 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9da0fa54-26e1-49fd-8f27-9228f01eec38 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:20.517757 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9da0fa54-26e1-49fd-8f27-9228f01eec38 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:20.518936 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9da0fa54-26e1-49fd-8f27-9228f01eec38 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:20.519774 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9da0fa54-26e1-49fd-8f27-9228f01eec38 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:20.567760 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-6cfbba77-d2ac-4013-ab7a-7e3c187a2544 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:20.568636 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-6cfbba77-d2ac-4013-ab7a-7e3c187a2544 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:20.577650 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6cfbba77-d2ac-4013-ab7a-7e3c187a2544 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:20.578393 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6cfbba77-d2ac-4013-ab7a-7e3c187a2544 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:20.579369 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6cfbba77-d2ac-4013-ab7a-7e3c187a2544 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:20.580209 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6cfbba77-d2ac-4013-ab7a-7e3c187a2544 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:20.935111 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-9da0fa54-26e1-49fd-8f27-9228f01eec38 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:20.944339 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-9da0fa54-26e1-49fd-8f27-9228f01eec38 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde" status: 200 len: 1365 microversion: 2.1 time: 0.439307 Jun 22 10:21:20.944512 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 43/84] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:20 2022] GET /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde => generated 1365 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:21.015231 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-6cfbba77-d2ac-4013-ab7a-7e3c187a2544 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:21.026696 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-6cfbba77-d2ac-4013-ab7a-7e3c187a2544 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1322 microversion: 2.1 time: 0.462464 Jun 22 10:21:21.027080 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 42/85] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:20 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1322 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:21:21.090324 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-05f770fc-ac29-472e-88fb-a392ed20579d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:21.091151 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-05f770fc-ac29-472e-88fb-a392ed20579d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:21.099415 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-05f770fc-ac29-472e-88fb-a392ed20579d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:21.099987 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-05f770fc-ac29-472e-88fb-a392ed20579d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:21.100931 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-05f770fc-ac29-472e-88fb-a392ed20579d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:21.101578 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-05f770fc-ac29-472e-88fb-a392ed20579d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:21.231950 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-a5d0946b-8d13-478b-b199-a3f3fe198fd5 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:21.236417 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-a5d0946b-8d13-478b-b199-a3f3fe198fd5 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: da28df11-c078-43d5-81c4-e78ccf9f6504] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:21.256900 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a5d0946b-8d13-478b-b199-a3f3fe198fd5 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:21.257427 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a5d0946b-8d13-478b-b199-a3f3fe198fd5 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:21.258255 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a5d0946b-8d13-478b-b199-a3f3fe198fd5 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:21.259093 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a5d0946b-8d13-478b-b199-a3f3fe198fd5 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:21.333880 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-05f770fc-ac29-472e-88fb-a392ed20579d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:21.349645 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-05f770fc-ac29-472e-88fb-a392ed20579d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:21.353763 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-05f770fc-ac29-472e-88fb-a392ed20579d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:21.359104 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-05f770fc-ac29-472e-88fb-a392ed20579d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1408 microversion: 2.20 time: 0.273532 Jun 22 10:21:21.359843 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 44/86] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:21:21 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1408 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:21:21.438999 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-a5d0946b-8d13-478b-b199-a3f3fe198fd5 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:21.447295 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-a5d0946b-8d13-478b-b199-a3f3fe198fd5 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504" status: 200 len: 1364 microversion: 2.1 time: 0.219080 Jun 22 10:21:21.448089 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 43/87] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:21 2022] GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504 => generated 1364 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:21:21.484536 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-6481d87a-7fad-4dce-a301-640da431ffc4 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:21.485166 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-6481d87a-7fad-4dce-a301-640da431ffc4 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] [instance: 76efde76-215b-4c32-992f-3fe518470987] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:21.493466 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6481d87a-7fad-4dce-a301-640da431ffc4 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:21.494117 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6481d87a-7fad-4dce-a301-640da431ffc4 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:21.494916 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6481d87a-7fad-4dce-a301-640da431ffc4 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:21.495341 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6481d87a-7fad-4dce-a301-640da431ffc4 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:21.658312 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-6481d87a-7fad-4dce-a301-640da431ffc4 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d2a62272e248d3b11aca8737e22fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e253dfe684b469383c18ff8c2a3dbd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:21.666736 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-6481d87a-7fad-4dce-a301-640da431ffc4 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] 10.222.0.66 "GET /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987" status: 200 len: 1315 microversion: 2.1 time: 0.186165 Jun 22 10:21:21.667892 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 45/88] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:21 2022] GET /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987 => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:21.961087 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-72b9d1e0-ac49-41b8-8b76-203766cc8bf7 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:21.961755 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-72b9d1e0-ac49-41b8-8b76-203766cc8bf7 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: c9505087-b458-46dc-9fbb-ee4ef61decde] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:21.968077 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-72b9d1e0-ac49-41b8-8b76-203766cc8bf7 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:21.968888 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-72b9d1e0-ac49-41b8-8b76-203766cc8bf7 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:21.969883 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-72b9d1e0-ac49-41b8-8b76-203766cc8bf7 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:21.970410 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-72b9d1e0-ac49-41b8-8b76-203766cc8bf7 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:22.051139 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-52c66c8b-316d-4627-b1af-e6645574c8f2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:22.052707 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-52c66c8b-316d-4627-b1af-e6645574c8f2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:22.063735 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-52c66c8b-316d-4627-b1af-e6645574c8f2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:22.065553 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-52c66c8b-316d-4627-b1af-e6645574c8f2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:22.066739 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-52c66c8b-316d-4627-b1af-e6645574c8f2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:22.068110 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-52c66c8b-316d-4627-b1af-e6645574c8f2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:22.221650 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-72b9d1e0-ac49-41b8-8b76-203766cc8bf7 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:22.230719 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-72b9d1e0-ac49-41b8-8b76-203766cc8bf7 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde" status: 200 len: 1365 microversion: 2.1 time: 0.273628 Jun 22 10:21:22.231664 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 44/89] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:21 2022] GET /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde => generated 1365 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:21:22.336252 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-52c66c8b-316d-4627-b1af-e6645574c8f2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:22.350624 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-52c66c8b-316d-4627-b1af-e6645574c8f2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1322 microversion: 2.1 time: 0.306268 Jun 22 10:21:22.352077 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 46/90] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:22 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1322 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:22.378231 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-13c7eccf-c58f-4ebf-b4f9-5bf11e45eb3f tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:22.379129 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-13c7eccf-c58f-4ebf-b4f9-5bf11e45eb3f tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:22.386303 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-13c7eccf-c58f-4ebf-b4f9-5bf11e45eb3f tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:22.387326 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-13c7eccf-c58f-4ebf-b4f9-5bf11e45eb3f tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:22.388132 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-13c7eccf-c58f-4ebf-b4f9-5bf11e45eb3f tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:22.388679 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-13c7eccf-c58f-4ebf-b4f9-5bf11e45eb3f tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:22.466363 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-8a0650d7-8dcb-448f-a67d-ddee5bf7a7ce tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:22.467031 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-8a0650d7-8dcb-448f-a67d-ddee5bf7a7ce tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: da28df11-c078-43d5-81c4-e78ccf9f6504] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:22.477575 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8a0650d7-8dcb-448f-a67d-ddee5bf7a7ce tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:22.478143 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8a0650d7-8dcb-448f-a67d-ddee5bf7a7ce tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:22.487891 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8a0650d7-8dcb-448f-a67d-ddee5bf7a7ce tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:22.488970 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8a0650d7-8dcb-448f-a67d-ddee5bf7a7ce tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:22.565566 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_cell1:SELECT=100 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:22.654741 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-13c7eccf-c58f-4ebf-b4f9-5bf11e45eb3f tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:22.670483 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-13c7eccf-c58f-4ebf-b4f9-5bf11e45eb3f tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:22.670483 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-13c7eccf-c58f-4ebf-b4f9-5bf11e45eb3f tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:22.673075 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-13c7eccf-c58f-4ebf-b4f9-5bf11e45eb3f tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1408 microversion: 2.20 time: 0.296437 Jun 22 10:21:22.681525 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 45/91] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:21:22 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1408 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:21:22.700050 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-ebeaa810-117a-43f9-8ef3-0a5195416f65 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:22.701373 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-ebeaa810-117a-43f9-8ef3-0a5195416f65 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] [instance: 76efde76-215b-4c32-992f-3fe518470987] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:22.717625 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ebeaa810-117a-43f9-8ef3-0a5195416f65 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:22.718089 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ebeaa810-117a-43f9-8ef3-0a5195416f65 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:22.718921 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ebeaa810-117a-43f9-8ef3-0a5195416f65 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:22.719357 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ebeaa810-117a-43f9-8ef3-0a5195416f65 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:22.804981 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-8a0650d7-8dcb-448f-a67d-ddee5bf7a7ce tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:22.817746 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-8a0650d7-8dcb-448f-a67d-ddee5bf7a7ce tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504" status: 200 len: 1364 microversion: 2.1 time: 0.353692 Jun 22 10:21:22.819417 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 47/92] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:22 2022] GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504 => generated 1364 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:22.895475 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-f033c74d-ad86-4b3b-85cd-e60901c5232e req-32039edf-7687-4153-97c1-93465b9ba93d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74f2497c-d91a-47be-b505-090e99ab9c52", "tag": "2c6f6652-0c2f-4ac8-85d8-e42607054324"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:21:22.902565 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-ebeaa810-117a-43f9-8ef3-0a5195416f65 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d2a62272e248d3b11aca8737e22fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e253dfe684b469383c18ff8c2a3dbd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:22.910486 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-ebeaa810-117a-43f9-8ef3-0a5195416f65 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] 10.222.0.66 "GET /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987" status: 200 len: 1315 microversion: 2.1 time: 0.222329 Jun 22 10:21:22.912057 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 46/93] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:22 2022] GET /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987 => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:22.925270 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-f033c74d-ad86-4b3b-85cd-e60901c5232e req-32039edf-7687-4153-97c1-93465b9ba93d service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:22.925969 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-f033c74d-ad86-4b3b-85cd-e60901c5232e req-32039edf-7687-4153-97c1-93465b9ba93d service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:22.957485 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-f033c74d-ad86-4b3b-85cd-e60901c5232e req-32039edf-7687-4153-97c1-93465b9ba93d service nova] Creating event network-changed:2c6f6652-0c2f-4ac8-85d8-e42607054324 for instance 74f2497c-d91a-47be-b505-090e99ab9c52 on hv-cinder-84713 Jun 22 10:21:22.972185 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-f033c74d-ad86-4b3b-85cd-e60901c5232e req-32039edf-7687-4153-97c1-93465b9ba93d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079134 Jun 22 10:21:22.974729 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 48/94] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:21:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:21:23.248987 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-8fe4313b-99b1-4b10-9764-d6a92fbcdcd9 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:23.250035 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-8fe4313b-99b1-4b10-9764-d6a92fbcdcd9 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: c9505087-b458-46dc-9fbb-ee4ef61decde] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:23.254799 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell0:SELECT=8 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:23.255843 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell0:SELECT=32 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:23.266057 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8fe4313b-99b1-4b10-9764-d6a92fbcdcd9 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:23.266620 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8fe4313b-99b1-4b10-9764-d6a92fbcdcd9 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:23.267576 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8fe4313b-99b1-4b10-9764-d6a92fbcdcd9 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:23.268185 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8fe4313b-99b1-4b10-9764-d6a92fbcdcd9 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:23.368748 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-6de14b8f-2810-4cd6-b6e4-164e4e04e7c1 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:23.373173 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-6de14b8f-2810-4cd6-b6e4-164e4e04e7c1 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:23.384667 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6de14b8f-2810-4cd6-b6e4-164e4e04e7c1 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:23.390449 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6de14b8f-2810-4cd6-b6e4-164e4e04e7c1 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:23.391551 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6de14b8f-2810-4cd6-b6e4-164e4e04e7c1 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:23.391998 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6de14b8f-2810-4cd6-b6e4-164e4e04e7c1 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:23.392639 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_cell0:SELECT=18 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:23.447663 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-8fe4313b-99b1-4b10-9764-d6a92fbcdcd9 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:23.470038 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-8fe4313b-99b1-4b10-9764-d6a92fbcdcd9 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde" status: 200 len: 1365 microversion: 2.1 time: 0.225132 Jun 22 10:21:23.471922 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 47/95] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:23 2022] GET /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde => generated 1365 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:23.609343 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-6de14b8f-2810-4cd6-b6e4-164e4e04e7c1 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:23.618912 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-6de14b8f-2810-4cd6-b6e4-164e4e04e7c1 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1322 microversion: 2.1 time: 0.254778 Jun 22 10:21:23.620039 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 49/96] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:23 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1322 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:23.691908 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-817f3d25-5164-4a74-b06a-6b15a910632e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:23.692638 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-817f3d25-5164-4a74-b06a-6b15a910632e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:23.701336 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-817f3d25-5164-4a74-b06a-6b15a910632e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:23.701866 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-817f3d25-5164-4a74-b06a-6b15a910632e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:23.702828 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-817f3d25-5164-4a74-b06a-6b15a910632e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:23.703497 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-817f3d25-5164-4a74-b06a-6b15a910632e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:23.841101 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-9ec12646-b55f-4f98-9e32-d5db050a6d77 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:23.842000 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-9ec12646-b55f-4f98-9e32-d5db050a6d77 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: da28df11-c078-43d5-81c4-e78ccf9f6504] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:23.851269 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9ec12646-b55f-4f98-9e32-d5db050a6d77 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:23.852021 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9ec12646-b55f-4f98-9e32-d5db050a6d77 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:23.853014 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9ec12646-b55f-4f98-9e32-d5db050a6d77 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:23.853470 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9ec12646-b55f-4f98-9e32-d5db050a6d77 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:23.856832 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-817f3d25-5164-4a74-b06a-6b15a910632e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:23.868130 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-817f3d25-5164-4a74-b06a-6b15a910632e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:23.870033 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-817f3d25-5164-4a74-b06a-6b15a910632e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:23.871559 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-817f3d25-5164-4a74-b06a-6b15a910632e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1408 microversion: 2.20 time: 0.183489 Jun 22 10:21:23.872340 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 48/97] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:21:23 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1408 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:21:23.948046 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-8615686c-cc64-4bc8-9ae3-f677b4ba47e1 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:23.949869 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-8615686c-cc64-4bc8-9ae3-f677b4ba47e1 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] [instance: 76efde76-215b-4c32-992f-3fe518470987] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:23.960216 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8615686c-cc64-4bc8-9ae3-f677b4ba47e1 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:23.960865 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8615686c-cc64-4bc8-9ae3-f677b4ba47e1 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:23.962565 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8615686c-cc64-4bc8-9ae3-f677b4ba47e1 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:23.963276 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8615686c-cc64-4bc8-9ae3-f677b4ba47e1 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:24.066701 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-9ec12646-b55f-4f98-9e32-d5db050a6d77 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:24.076736 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-9ec12646-b55f-4f98-9e32-d5db050a6d77 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504" status: 200 len: 1364 microversion: 2.1 time: 0.244921 Jun 22 10:21:24.077346 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 50/98] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:23 2022] GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504 => generated 1364 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:24.164670 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-8615686c-cc64-4bc8-9ae3-f677b4ba47e1 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d2a62272e248d3b11aca8737e22fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e253dfe684b469383c18ff8c2a3dbd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:24.173182 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-8615686c-cc64-4bc8-9ae3-f677b4ba47e1 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] 10.222.0.66 "GET /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987" status: 200 len: 1315 microversion: 2.1 time: 0.232671 Jun 22 10:21:24.174029 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 49/99] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:23 2022] GET /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987 => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:21:24.487876 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-bed3e2ae-62ab-491b-b4e9-4b947c90bf66 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:24.489284 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-bed3e2ae-62ab-491b-b4e9-4b947c90bf66 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: c9505087-b458-46dc-9fbb-ee4ef61decde] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:24.496895 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-bed3e2ae-62ab-491b-b4e9-4b947c90bf66 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:24.497757 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-bed3e2ae-62ab-491b-b4e9-4b947c90bf66 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:24.498975 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-bed3e2ae-62ab-491b-b4e9-4b947c90bf66 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:24.499659 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-bed3e2ae-62ab-491b-b4e9-4b947c90bf66 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:24.641282 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-b0fabe53-391c-4536-a8d0-a8348c1db6e4 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:24.643026 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-b0fabe53-391c-4536-a8d0-a8348c1db6e4 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:24.654356 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b0fabe53-391c-4536-a8d0-a8348c1db6e4 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:24.655256 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b0fabe53-391c-4536-a8d0-a8348c1db6e4 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:24.656785 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b0fabe53-391c-4536-a8d0-a8348c1db6e4 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:24.658055 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b0fabe53-391c-4536-a8d0-a8348c1db6e4 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:24.762324 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-bed3e2ae-62ab-491b-b4e9-4b947c90bf66 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:24.770513 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-bed3e2ae-62ab-491b-b4e9-4b947c90bf66 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde" status: 200 len: 1365 microversion: 2.1 time: 0.286705 Jun 22 10:21:24.771327 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 51/100] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:24 2022] GET /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde => generated 1365 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:24.848014 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-b0fabe53-391c-4536-a8d0-a8348c1db6e4 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:24.856414 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-b0fabe53-391c-4536-a8d0-a8348c1db6e4 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1322 microversion: 2.1 time: 0.221657 Jun 22 10:21:24.857718 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 50/101] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:24 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:21:24.891110 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-80036ec9-ce99-4661-8d7c-570c9d08c0e2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:24.892275 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-80036ec9-ce99-4661-8d7c-570c9d08c0e2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:24.900353 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-80036ec9-ce99-4661-8d7c-570c9d08c0e2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:24.901016 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-80036ec9-ce99-4661-8d7c-570c9d08c0e2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:24.902014 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-80036ec9-ce99-4661-8d7c-570c9d08c0e2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:24.902641 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-80036ec9-ce99-4661-8d7c-570c9d08c0e2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:25.061915 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-80036ec9-ce99-4661-8d7c-570c9d08c0e2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:25.072155 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-80036ec9-ce99-4661-8d7c-570c9d08c0e2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:25.075021 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-80036ec9-ce99-4661-8d7c-570c9d08c0e2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:25.076728 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-80036ec9-ce99-4661-8d7c-570c9d08c0e2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1408 microversion: 2.20 time: 0.190824 Jun 22 10:21:25.078951 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 52/102] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:21:24 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1408 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:21:25.096950 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-853e91e9-b838-4026-8eef-78657754e79c tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:25.099361 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-853e91e9-b838-4026-8eef-78657754e79c tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: da28df11-c078-43d5-81c4-e78ccf9f6504] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:25.113732 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-853e91e9-b838-4026-8eef-78657754e79c tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:25.114104 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-853e91e9-b838-4026-8eef-78657754e79c tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:25.115245 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-853e91e9-b838-4026-8eef-78657754e79c tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:25.117313 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-853e91e9-b838-4026-8eef-78657754e79c tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:25.195691 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-ad9e4039-92cb-40ab-9b5b-23fc24c20b9f tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:25.197751 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-ad9e4039-92cb-40ab-9b5b-23fc24c20b9f tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] [instance: 76efde76-215b-4c32-992f-3fe518470987] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:25.213659 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ad9e4039-92cb-40ab-9b5b-23fc24c20b9f tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:25.214117 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ad9e4039-92cb-40ab-9b5b-23fc24c20b9f tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:25.214954 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ad9e4039-92cb-40ab-9b5b-23fc24c20b9f tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:25.216224 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ad9e4039-92cb-40ab-9b5b-23fc24c20b9f tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:25.333803 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-853e91e9-b838-4026-8eef-78657754e79c tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:25.342787 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-853e91e9-b838-4026-8eef-78657754e79c tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504" status: 200 len: 1364 microversion: 2.1 time: 0.250766 Jun 22 10:21:25.344984 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 51/103] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:25 2022] GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504 => generated 1364 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:25.443475 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-ad9e4039-92cb-40ab-9b5b-23fc24c20b9f tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d2a62272e248d3b11aca8737e22fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e253dfe684b469383c18ff8c2a3dbd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:25.450657 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-ad9e4039-92cb-40ab-9b5b-23fc24c20b9f tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] 10.222.0.66 "GET /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987" status: 200 len: 1315 microversion: 2.1 time: 0.263194 Jun 22 10:21:25.461079 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 53/104] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:25 2022] GET /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987 => generated 1315 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:21:25.787800 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-1e49f4b9-f850-4707-8779-31573e625d42 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:25.789255 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-1e49f4b9-f850-4707-8779-31573e625d42 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: c9505087-b458-46dc-9fbb-ee4ef61decde] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:25.796891 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1e49f4b9-f850-4707-8779-31573e625d42 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:25.797529 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1e49f4b9-f850-4707-8779-31573e625d42 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:25.798465 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1e49f4b9-f850-4707-8779-31573e625d42 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:25.799105 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1e49f4b9-f850-4707-8779-31573e625d42 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:25.873465 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-7edb6a91-b09a-47e2-a82d-b5b1c50b561a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:25.874235 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-7edb6a91-b09a-47e2-a82d-b5b1c50b561a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:25.880927 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7edb6a91-b09a-47e2-a82d-b5b1c50b561a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:25.881667 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7edb6a91-b09a-47e2-a82d-b5b1c50b561a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:25.882717 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7edb6a91-b09a-47e2-a82d-b5b1c50b561a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:25.883595 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7edb6a91-b09a-47e2-a82d-b5b1c50b561a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:26.002670 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-1e49f4b9-f850-4707-8779-31573e625d42 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:26.012339 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-1e49f4b9-f850-4707-8779-31573e625d42 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde" status: 200 len: 1365 microversion: 2.1 time: 0.228257 Jun 22 10:21:26.013488 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 52/105] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:25 2022] GET /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde => generated 1365 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:26.018528 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-6a1f574a-33f6-4057-a393-4be7ef903d9e req-14f09621-0692-4ed1-b49c-0d94e64edfa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "755c0b10-e04a-42fa-86da-8cc65537315d", "name": "network-vif-plugged", "status": "completed", "tag": "2931da67-7e8b-43c4-9fbb-3adba1b7225a"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:21:26.036907 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-6a1f574a-33f6-4057-a393-4be7ef903d9e req-14f09621-0692-4ed1-b49c-0d94e64edfa2 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:26.037389 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-6a1f574a-33f6-4057-a393-4be7ef903d9e req-14f09621-0692-4ed1-b49c-0d94e64edfa2 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:26.053206 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-6a1f574a-33f6-4057-a393-4be7ef903d9e req-14f09621-0692-4ed1-b49c-0d94e64edfa2 service nova] Creating event network-vif-plugged:2931da67-7e8b-43c4-9fbb-3adba1b7225a for instance 755c0b10-e04a-42fa-86da-8cc65537315d on hv-cinder-84713 Jun 22 10:21:26.060309 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-6a1f574a-33f6-4057-a393-4be7ef903d9e req-14f09621-0692-4ed1-b49c-0d94e64edfa2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045058 Jun 22 10:21:26.061112 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 53/106] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:21:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:21:26.082295 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-7edb6a91-b09a-47e2-a82d-b5b1c50b561a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:26.092101 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-7edb6a91-b09a-47e2-a82d-b5b1c50b561a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1322 microversion: 2.1 time: 0.222198 Jun 22 10:21:26.092907 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 54/107] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:25 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1322 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:26.099085 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-20e9329b-07c3-4076-9e79-db96651038e4 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:26.099784 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-20e9329b-07c3-4076-9e79-db96651038e4 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:26.107596 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-20e9329b-07c3-4076-9e79-db96651038e4 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:26.108181 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-20e9329b-07c3-4076-9e79-db96651038e4 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:26.109096 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-20e9329b-07c3-4076-9e79-db96651038e4 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:26.109629 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-20e9329b-07c3-4076-9e79-db96651038e4 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:26.262292 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-20e9329b-07c3-4076-9e79-db96651038e4 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:26.272499 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-20e9329b-07c3-4076-9e79-db96651038e4 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:26.274276 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-20e9329b-07c3-4076-9e79-db96651038e4 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:26.275816 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-20e9329b-07c3-4076-9e79-db96651038e4 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1408 microversion: 2.20 time: 0.181624 Jun 22 10:21:26.280542 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 54/108] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:21:26 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1408 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:21:26.361248 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-0bc1729c-26a4-4ed4-b8b2-671a70d078b2 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:26.361862 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-0bc1729c-26a4-4ed4-b8b2-671a70d078b2 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: da28df11-c078-43d5-81c4-e78ccf9f6504] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:26.368216 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0bc1729c-26a4-4ed4-b8b2-671a70d078b2 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:26.368901 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0bc1729c-26a4-4ed4-b8b2-671a70d078b2 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:26.369681 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0bc1729c-26a4-4ed4-b8b2-671a70d078b2 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:26.370406 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0bc1729c-26a4-4ed4-b8b2-671a70d078b2 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:26.471718 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-b9effff5-800e-45cb-8158-b12bbd404bb3 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:26.472651 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-b9effff5-800e-45cb-8158-b12bbd404bb3 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] [instance: 76efde76-215b-4c32-992f-3fe518470987] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:26.492802 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b9effff5-800e-45cb-8158-b12bbd404bb3 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:26.493259 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b9effff5-800e-45cb-8158-b12bbd404bb3 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:26.494069 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b9effff5-800e-45cb-8158-b12bbd404bb3 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:26.494522 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b9effff5-800e-45cb-8158-b12bbd404bb3 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:26.534629 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-0bc1729c-26a4-4ed4-b8b2-671a70d078b2 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:26.543770 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-0bc1729c-26a4-4ed4-b8b2-671a70d078b2 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504" status: 200 len: 1364 microversion: 2.1 time: 0.186330 Jun 22 10:21:26.544457 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 55/109] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:26 2022] GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504 => generated 1364 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:26.650940 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-b9effff5-800e-45cb-8158-b12bbd404bb3 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d2a62272e248d3b11aca8737e22fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e253dfe684b469383c18ff8c2a3dbd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:26.658766 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-b9effff5-800e-45cb-8158-b12bbd404bb3 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] 10.222.0.66 "GET /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987" status: 200 len: 1315 microversion: 2.1 time: 0.192274 Jun 22 10:21:26.659362 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 55/110] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:26 2022] GET /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987 => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:27.030095 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-03b498d8-043a-4e99-8e01-bf8519966386 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:27.031079 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-03b498d8-043a-4e99-8e01-bf8519966386 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: c9505087-b458-46dc-9fbb-ee4ef61decde] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:27.037497 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-03b498d8-043a-4e99-8e01-bf8519966386 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:27.038030 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-03b498d8-043a-4e99-8e01-bf8519966386 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:27.038838 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-03b498d8-043a-4e99-8e01-bf8519966386 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:27.039269 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-03b498d8-043a-4e99-8e01-bf8519966386 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:27.108280 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-4a8e6c94-2010-45db-9c96-3b951e01d725 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:27.109738 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-4a8e6c94-2010-45db-9c96-3b951e01d725 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:27.117324 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4a8e6c94-2010-45db-9c96-3b951e01d725 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:27.117829 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4a8e6c94-2010-45db-9c96-3b951e01d725 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:27.118893 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4a8e6c94-2010-45db-9c96-3b951e01d725 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:27.119334 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4a8e6c94-2010-45db-9c96-3b951e01d725 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:27.288975 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-03b498d8-043a-4e99-8e01-bf8519966386 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:27.297955 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-03b498d8-043a-4e99-8e01-bf8519966386 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde" status: 200 len: 1365 microversion: 2.1 time: 0.271689 Jun 22 10:21:27.299062 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 56/111] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:27 2022] GET /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde => generated 1365 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:27.306063 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-243d2401-1a0f-4f19-9451-0844f5f7b681 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:27.307007 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-243d2401-1a0f-4f19-9451-0844f5f7b681 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:27.314921 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-243d2401-1a0f-4f19-9451-0844f5f7b681 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:27.315465 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-243d2401-1a0f-4f19-9451-0844f5f7b681 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:27.316373 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-243d2401-1a0f-4f19-9451-0844f5f7b681 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:27.317287 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-243d2401-1a0f-4f19-9451-0844f5f7b681 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:27.423891 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-4a8e6c94-2010-45db-9c96-3b951e01d725 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:27.432862 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-4a8e6c94-2010-45db-9c96-3b951e01d725 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1322 microversion: 2.1 time: 0.328476 Jun 22 10:21:27.433811 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 56/112] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:27 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1322 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:21:27.528887 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-243d2401-1a0f-4f19-9451-0844f5f7b681 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:27.551242 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-243d2401-1a0f-4f19-9451-0844f5f7b681 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:27.553091 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-243d2401-1a0f-4f19-9451-0844f5f7b681 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:27.554709 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-243d2401-1a0f-4f19-9451-0844f5f7b681 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1408 microversion: 2.20 time: 0.253636 Jun 22 10:21:27.561659 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-cd7a2e00-79c8-4b48-a23b-d5f66bd3aaaa tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:27.562363 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-cd7a2e00-79c8-4b48-a23b-d5f66bd3aaaa tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: da28df11-c078-43d5-81c4-e78ccf9f6504] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:27.566195 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 57/113] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:21:27 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1408 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:21:27.576015 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-cd7a2e00-79c8-4b48-a23b-d5f66bd3aaaa tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:27.576970 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-cd7a2e00-79c8-4b48-a23b-d5f66bd3aaaa tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:27.578044 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-cd7a2e00-79c8-4b48-a23b-d5f66bd3aaaa tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:27.578663 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-cd7a2e00-79c8-4b48-a23b-d5f66bd3aaaa tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:27.678955 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-4c6ce37c-ef05-4293-9531-a3a934f9428a tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:27.679820 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-4c6ce37c-ef05-4293-9531-a3a934f9428a tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] [instance: 76efde76-215b-4c32-992f-3fe518470987] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:27.682908 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:27.699833 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4c6ce37c-ef05-4293-9531-a3a934f9428a tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:27.707115 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4c6ce37c-ef05-4293-9531-a3a934f9428a tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:27.708454 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4c6ce37c-ef05-4293-9531-a3a934f9428a tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:27.709064 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4c6ce37c-ef05-4293-9531-a3a934f9428a tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:27.903333 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-cd7a2e00-79c8-4b48-a23b-d5f66bd3aaaa tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:27.917014 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-cd7a2e00-79c8-4b48-a23b-d5f66bd3aaaa tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504" status: 200 len: 1364 microversion: 2.1 time: 0.358848 Jun 22 10:21:27.919750 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 57/114] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:27 2022] GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504 => generated 1364 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:27.999138 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-4c6ce37c-ef05-4293-9531-a3a934f9428a tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d2a62272e248d3b11aca8737e22fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e253dfe684b469383c18ff8c2a3dbd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:28.009342 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-4c6ce37c-ef05-4293-9531-a3a934f9428a tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] 10.222.0.66 "GET /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987" status: 200 len: 1315 microversion: 2.1 time: 0.335764 Jun 22 10:21:28.009978 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 58/115] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:27 2022] GET /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987 => generated 1315 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:28.319723 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-7911e099-f799-4f14-b243-d9ee294a4d5d tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:28.321498 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-7911e099-f799-4f14-b243-d9ee294a4d5d tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: c9505087-b458-46dc-9fbb-ee4ef61decde] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:28.332123 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7911e099-f799-4f14-b243-d9ee294a4d5d tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:28.334094 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7911e099-f799-4f14-b243-d9ee294a4d5d tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:28.335851 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7911e099-f799-4f14-b243-d9ee294a4d5d tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:28.336327 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7911e099-f799-4f14-b243-d9ee294a4d5d tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:28.341649 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:SELECT=100 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:28.449747 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-a42c2495-e1e5-44e2-ac74-7cb4c5613952 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:28.451482 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-a42c2495-e1e5-44e2-ac74-7cb4c5613952 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:28.466481 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a42c2495-e1e5-44e2-ac74-7cb4c5613952 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:28.467471 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a42c2495-e1e5-44e2-ac74-7cb4c5613952 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:28.468536 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a42c2495-e1e5-44e2-ac74-7cb4c5613952 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:28.469200 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a42c2495-e1e5-44e2-ac74-7cb4c5613952 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:29.446781 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-7911e099-f799-4f14-b243-d9ee294a4d5d tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:29.460372 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-7911e099-f799-4f14-b243-d9ee294a4d5d tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde" status: 200 len: 1365 microversion: 2.1 time: 1.147518 Jun 22 10:21:29.460964 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 58/116] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:28 2022] GET /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde => generated 1365 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:29.466840 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-a1e15039-4885-419f-8d15-5ad47ecafae8 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:29.467444 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-a1e15039-4885-419f-8d15-5ad47ecafae8 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:29.475214 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a1e15039-4885-419f-8d15-5ad47ecafae8 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:29.475601 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a1e15039-4885-419f-8d15-5ad47ecafae8 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:29.476571 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a1e15039-4885-419f-8d15-5ad47ecafae8 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:29.476993 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a1e15039-4885-419f-8d15-5ad47ecafae8 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:29.483765 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-a42c2495-e1e5-44e2-ac74-7cb4c5613952 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:29.492962 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-a42c2495-e1e5-44e2-ac74-7cb4c5613952 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1322 microversion: 2.1 time: 1.047285 Jun 22 10:21:29.493563 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 59/117] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:28 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1322 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:29.501057 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-efa82fd5-3e2f-45e1-82e2-ef0a496abc79 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:29.502111 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-efa82fd5-3e2f-45e1-82e2-ef0a496abc79 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: da28df11-c078-43d5-81c4-e78ccf9f6504] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:29.515211 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-efa82fd5-3e2f-45e1-82e2-ef0a496abc79 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:29.515916 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-efa82fd5-3e2f-45e1-82e2-ef0a496abc79 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:29.516987 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-efa82fd5-3e2f-45e1-82e2-ef0a496abc79 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:29.517565 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-efa82fd5-3e2f-45e1-82e2-ef0a496abc79 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:29.873880 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_cell0:SELECT=2 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:30.168699 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-a1e15039-4885-419f-8d15-5ad47ecafae8 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:30.175125 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-efa82fd5-3e2f-45e1-82e2-ef0a496abc79 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:30.181029 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-a1e15039-4885-419f-8d15-5ad47ecafae8 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:30.183689 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-efa82fd5-3e2f-45e1-82e2-ef0a496abc79 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504" status: 200 len: 1364 microversion: 2.1 time: 0.687450 Jun 22 10:21:30.184333 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 60/118] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:29 2022] GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504 => generated 1364 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:30.191079 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-a1e15039-4885-419f-8d15-5ad47ecafae8 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:30.199566 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-a1e15039-4885-419f-8d15-5ad47ecafae8 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1408 microversion: 2.20 time: 0.732767 Jun 22 10:21:30.210242 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 59/119] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:21:29 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1408 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:21:30.210456 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-ec5fa399-d3b5-43ea-aa4d-01ce73150a77 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:30.210456 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-ec5fa399-d3b5-43ea-aa4d-01ce73150a77 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] [instance: 76efde76-215b-4c32-992f-3fe518470987] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:30.217493 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ec5fa399-d3b5-43ea-aa4d-01ce73150a77 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:30.218394 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ec5fa399-d3b5-43ea-aa4d-01ce73150a77 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:30.221281 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ec5fa399-d3b5-43ea-aa4d-01ce73150a77 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:30.221781 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ec5fa399-d3b5-43ea-aa4d-01ce73150a77 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:30.354495 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-b17d27cc-44f6-46ae-b238-05c5017571ac req-3f118238-26ba-4fc2-a2da-0fc5d31578f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "739e9dbf-4ccc-4022-83e4-d2f4c36955ee", "name": "network-vif-plugged", "status": "completed", "tag": "66ed55a7-8e67-4d46-9b13-c7875b6be0f5"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:21:30.364920 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-b17d27cc-44f6-46ae-b238-05c5017571ac req-3f118238-26ba-4fc2-a2da-0fc5d31578f9 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:30.365371 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-b17d27cc-44f6-46ae-b238-05c5017571ac req-3f118238-26ba-4fc2-a2da-0fc5d31578f9 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:30.394260 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-b17d27cc-44f6-46ae-b238-05c5017571ac req-3f118238-26ba-4fc2-a2da-0fc5d31578f9 service nova] Creating event network-vif-plugged:66ed55a7-8e67-4d46-9b13-c7875b6be0f5 for instance 739e9dbf-4ccc-4022-83e4-d2f4c36955ee on hv-cinder-84713 Jun 22 10:21:30.401109 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-b17d27cc-44f6-46ae-b238-05c5017571ac req-3f118238-26ba-4fc2-a2da-0fc5d31578f9 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050884 Jun 22 10:21:30.402218 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 60/120] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:21:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:21:30.427316 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-ec5fa399-d3b5-43ea-aa4d-01ce73150a77 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d2a62272e248d3b11aca8737e22fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e253dfe684b469383c18ff8c2a3dbd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:30.435371 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-ec5fa399-d3b5-43ea-aa4d-01ce73150a77 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] 10.222.0.66 "GET /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987" status: 200 len: 1315 microversion: 2.1 time: 0.246755 Jun 22 10:21:30.435962 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 61/121] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:30 2022] GET /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987 => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:30.478031 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-91f671d9-d317-4571-bdce-30caba74da82 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:30.478739 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-91f671d9-d317-4571-bdce-30caba74da82 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: c9505087-b458-46dc-9fbb-ee4ef61decde] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:30.485234 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-91f671d9-d317-4571-bdce-30caba74da82 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:30.485683 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-91f671d9-d317-4571-bdce-30caba74da82 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:30.486454 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-91f671d9-d317-4571-bdce-30caba74da82 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:30.486929 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-91f671d9-d317-4571-bdce-30caba74da82 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:30.510744 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-a435d31a-4007-4676-85fa-19463636e62d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:30.512074 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-a435d31a-4007-4676-85fa-19463636e62d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:30.518321 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a435d31a-4007-4676-85fa-19463636e62d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:30.519116 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a435d31a-4007-4676-85fa-19463636e62d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:30.520222 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a435d31a-4007-4676-85fa-19463636e62d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:30.520732 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a435d31a-4007-4676-85fa-19463636e62d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:30.708742 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-91f671d9-d317-4571-bdce-30caba74da82 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:30.713396 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-91f671d9-d317-4571-bdce-30caba74da82 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde" status: 200 len: 1365 microversion: 2.1 time: 0.239763 Jun 22 10:21:30.713564 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-a435d31a-4007-4676-85fa-19463636e62d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:30.713986 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 61/122] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:30 2022] GET /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde => generated 1365 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:30.721626 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-a435d31a-4007-4676-85fa-19463636e62d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1322 microversion: 2.1 time: 0.214879 Jun 22 10:21:30.725401 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 62/123] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:30 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1322 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:31.209081 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-96c5e9d1-7f61-4b1f-ac47-983abc68b671 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:31.210035 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-96c5e9d1-7f61-4b1f-ac47-983abc68b671 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: da28df11-c078-43d5-81c4-e78ccf9f6504] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:31.217013 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-96c5e9d1-7f61-4b1f-ac47-983abc68b671 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:31.217632 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-96c5e9d1-7f61-4b1f-ac47-983abc68b671 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:31.218581 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-96c5e9d1-7f61-4b1f-ac47-983abc68b671 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:31.219162 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-96c5e9d1-7f61-4b1f-ac47-983abc68b671 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:31.221675 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-992d77f2-344c-4483-929f-b3edcb0791f9 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:31.222280 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-992d77f2-344c-4483-929f-b3edcb0791f9 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:31.232730 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-992d77f2-344c-4483-929f-b3edcb0791f9 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:31.233383 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-992d77f2-344c-4483-929f-b3edcb0791f9 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:31.235197 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-992d77f2-344c-4483-929f-b3edcb0791f9 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:31.235941 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-992d77f2-344c-4483-929f-b3edcb0791f9 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:31.499901 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-96c5e9d1-7f61-4b1f-ac47-983abc68b671 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:31.517748 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-96c5e9d1-7f61-4b1f-ac47-983abc68b671 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504" status: 200 len: 1364 microversion: 2.1 time: 0.319663 Jun 22 10:21:31.518365 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 62/124] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:31 2022] GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504 => generated 1364 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:31.519368 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-992d77f2-344c-4483-929f-b3edcb0791f9 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:31.526259 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-c3b9cbb1-c2c1-4593-89ea-9e25df3dc340 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:31.527164 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-c3b9cbb1-c2c1-4593-89ea-9e25df3dc340 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] [instance: 76efde76-215b-4c32-992f-3fe518470987] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:31.535031 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-c3b9cbb1-c2c1-4593-89ea-9e25df3dc340 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:31.535481 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-c3b9cbb1-c2c1-4593-89ea-9e25df3dc340 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:31.536346 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-c3b9cbb1-c2c1-4593-89ea-9e25df3dc340 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:31.536985 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-c3b9cbb1-c2c1-4593-89ea-9e25df3dc340 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:31.542705 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-992d77f2-344c-4483-929f-b3edcb0791f9 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:31.546415 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-992d77f2-344c-4483-929f-b3edcb0791f9 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:31.549652 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-992d77f2-344c-4483-929f-b3edcb0791f9 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1408 microversion: 2.20 time: 0.331041 Jun 22 10:21:31.551408 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 63/125] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:21:31 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1408 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:21:31.730035 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-c3b9cbb1-c2c1-4593-89ea-9e25df3dc340 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d2a62272e248d3b11aca8737e22fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e253dfe684b469383c18ff8c2a3dbd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:31.734103 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-78abd54a-31a8-4c07-83c0-923180ffedfb tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:31.735027 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-78abd54a-31a8-4c07-83c0-923180ffedfb tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: c9505087-b458-46dc-9fbb-ee4ef61decde] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:31.745492 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-78abd54a-31a8-4c07-83c0-923180ffedfb tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:31.746218 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-78abd54a-31a8-4c07-83c0-923180ffedfb tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:31.747515 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-78abd54a-31a8-4c07-83c0-923180ffedfb tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:31.748230 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-78abd54a-31a8-4c07-83c0-923180ffedfb tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:31.750931 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-c3b9cbb1-c2c1-4593-89ea-9e25df3dc340 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] 10.222.0.66 "GET /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987" status: 200 len: 1315 microversion: 2.1 time: 0.230191 Jun 22 10:21:31.752073 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 63/126] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:31 2022] GET /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987 => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:31.761212 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-b2c711e8-88ac-4023-802c-7c5aa2789c08 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:31.762737 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-b2c711e8-88ac-4023-802c-7c5aa2789c08 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:31.779681 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b2c711e8-88ac-4023-802c-7c5aa2789c08 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:31.780248 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b2c711e8-88ac-4023-802c-7c5aa2789c08 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:31.781422 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b2c711e8-88ac-4023-802c-7c5aa2789c08 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:31.782040 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b2c711e8-88ac-4023-802c-7c5aa2789c08 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:31.786402 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_cell1:SELECT=100 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:31.983207 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-78abd54a-31a8-4c07-83c0-923180ffedfb tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:31.986396 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-b2c711e8-88ac-4023-802c-7c5aa2789c08 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:31.991116 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-78abd54a-31a8-4c07-83c0-923180ffedfb tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde" status: 200 len: 1365 microversion: 2.1 time: 0.264134 Jun 22 10:21:31.991735 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 64/127] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:31 2022] GET /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde => generated 1365 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:31.994496 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-b2c711e8-88ac-4023-802c-7c5aa2789c08 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1322 microversion: 2.1 time: 0.240578 Jun 22 10:21:32.003703 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 64/128] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:31 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1322 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:32.432628 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-f9f7feb2-6cc3-43c8-9983-ee05ff0b3788 req-7680c2ad-4e49-457c-a819-df7d5ed9b750 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da28df11-c078-43d5-81c4-e78ccf9f6504", "name": "network-vif-plugged", "status": "completed", "tag": "937e9931-d784-4d24-8619-009399b6a8d5"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:21:32.444064 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-f9f7feb2-6cc3-43c8-9983-ee05ff0b3788 req-7680c2ad-4e49-457c-a819-df7d5ed9b750 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:32.448049 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-f9f7feb2-6cc3-43c8-9983-ee05ff0b3788 req-7680c2ad-4e49-457c-a819-df7d5ed9b750 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:32.467642 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-f9f7feb2-6cc3-43c8-9983-ee05ff0b3788 req-7680c2ad-4e49-457c-a819-df7d5ed9b750 service nova] Creating event network-vif-plugged:937e9931-d784-4d24-8619-009399b6a8d5 for instance da28df11-c078-43d5-81c4-e78ccf9f6504 on hv-cinder-84713 Jun 22 10:21:32.472880 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-f9f7feb2-6cc3-43c8-9983-ee05ff0b3788 req-7680c2ad-4e49-457c-a819-df7d5ed9b750 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044067 Jun 22 10:21:32.473717 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 65/129] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:21:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:21:32.535772 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-d0376418-b024-4edd-b90c-a1ef0423badf tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:32.536389 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-d0376418-b024-4edd-b90c-a1ef0423badf tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: da28df11-c078-43d5-81c4-e78ccf9f6504] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:32.543387 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d0376418-b024-4edd-b90c-a1ef0423badf tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:32.543387 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d0376418-b024-4edd-b90c-a1ef0423badf tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:32.544457 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d0376418-b024-4edd-b90c-a1ef0423badf tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:32.544552 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d0376418-b024-4edd-b90c-a1ef0423badf tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:32.577638 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-9b8cb517-cb6d-4944-bded-59386b8d1693 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:32.578542 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-9b8cb517-cb6d-4944-bded-59386b8d1693 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:32.585660 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9b8cb517-cb6d-4944-bded-59386b8d1693 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:32.586114 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9b8cb517-cb6d-4944-bded-59386b8d1693 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:32.588762 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9b8cb517-cb6d-4944-bded-59386b8d1693 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:32.589416 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9b8cb517-cb6d-4944-bded-59386b8d1693 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:32.840142 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-d0376418-b024-4edd-b90c-a1ef0423badf tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:32.846295 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-9b8cb517-cb6d-4944-bded-59386b8d1693 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:32.852311 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-d0376418-b024-4edd-b90c-a1ef0423badf tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504" status: 200 len: 1364 microversion: 2.1 time: 0.320162 Jun 22 10:21:32.853821 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 65/130] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:32 2022] GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504 => generated 1364 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:32.857005 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-9b8cb517-cb6d-4944-bded-59386b8d1693 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:32.858887 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-44c2dc1c-b348-4226-a360-069bfeaa2d4d tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:32.859846 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-44c2dc1c-b348-4226-a360-069bfeaa2d4d tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] [instance: 76efde76-215b-4c32-992f-3fe518470987] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:32.862066 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-9b8cb517-cb6d-4944-bded-59386b8d1693 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:32.864398 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-9b8cb517-cb6d-4944-bded-59386b8d1693 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1408 microversion: 2.20 time: 0.300123 Jun 22 10:21:32.865553 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 66/131] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:21:32 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1408 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:21:32.871740 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-44c2dc1c-b348-4226-a360-069bfeaa2d4d tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:32.872267 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-44c2dc1c-b348-4226-a360-069bfeaa2d4d tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:32.873038 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-44c2dc1c-b348-4226-a360-069bfeaa2d4d tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:32.873475 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-44c2dc1c-b348-4226-a360-069bfeaa2d4d tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:33.008944 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-41b6d7ae-f406-4705-8e95-8aee0fba226e tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:33.010311 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-41b6d7ae-f406-4705-8e95-8aee0fba226e tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: c9505087-b458-46dc-9fbb-ee4ef61decde] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:33.019239 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-41b6d7ae-f406-4705-8e95-8aee0fba226e tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:33.019437 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-41b6d7ae-f406-4705-8e95-8aee0fba226e tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:33.020369 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-41b6d7ae-f406-4705-8e95-8aee0fba226e tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:33.020938 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-41b6d7ae-f406-4705-8e95-8aee0fba226e tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:33.022789 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-44c2dc1c-b348-4226-a360-069bfeaa2d4d tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d2a62272e248d3b11aca8737e22fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e253dfe684b469383c18ff8c2a3dbd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:33.033039 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-44c2dc1c-b348-4226-a360-069bfeaa2d4d tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] 10.222.0.66 "GET /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987" status: 200 len: 1315 microversion: 2.1 time: 0.177784 Jun 22 10:21:33.033818 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 66/132] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:32 2022] GET /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:33.044119 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-0165c29c-fd93-4f46-aac3-82af1781c668 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:33.045863 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-0165c29c-fd93-4f46-aac3-82af1781c668 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:33.053169 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0165c29c-fd93-4f46-aac3-82af1781c668 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:33.053930 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0165c29c-fd93-4f46-aac3-82af1781c668 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:33.054783 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0165c29c-fd93-4f46-aac3-82af1781c668 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:33.055348 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0165c29c-fd93-4f46-aac3-82af1781c668 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:33.221539 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-41b6d7ae-f406-4705-8e95-8aee0fba226e tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:33.229866 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-41b6d7ae-f406-4705-8e95-8aee0fba226e tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde" status: 200 len: 1365 microversion: 2.1 time: 0.225019 Jun 22 10:21:33.230893 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 67/133] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:33 2022] GET /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde => generated 1365 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:21:33.244945 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-0165c29c-fd93-4f46-aac3-82af1781c668 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:33.252829 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-0165c29c-fd93-4f46-aac3-82af1781c668 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1322 microversion: 2.1 time: 0.214421 Jun 22 10:21:33.253408 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 67/134] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:33 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:33.876922 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-3b03d55e-9335-4f38-9b40-44800d9d4f36 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:33.878401 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-3b03d55e-9335-4f38-9b40-44800d9d4f36 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: da28df11-c078-43d5-81c4-e78ccf9f6504] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:33.889339 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3b03d55e-9335-4f38-9b40-44800d9d4f36 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:33.890619 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-321a4d82-519c-4a21-b065-91f61ab0609c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:33.891206 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-321a4d82-519c-4a21-b065-91f61ab0609c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:33.891684 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3b03d55e-9335-4f38-9b40-44800d9d4f36 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:33.892654 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3b03d55e-9335-4f38-9b40-44800d9d4f36 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:33.893538 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3b03d55e-9335-4f38-9b40-44800d9d4f36 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:33.898993 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-321a4d82-519c-4a21-b065-91f61ab0609c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:33.899676 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-321a4d82-519c-4a21-b065-91f61ab0609c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:33.900841 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-321a4d82-519c-4a21-b065-91f61ab0609c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:33.902023 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-321a4d82-519c-4a21-b065-91f61ab0609c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:34.115410 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-3b03d55e-9335-4f38-9b40-44800d9d4f36 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:34.128083 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-3b03d55e-9335-4f38-9b40-44800d9d4f36 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504" status: 200 len: 1364 microversion: 2.1 time: 0.257291 Jun 22 10:21:34.129866 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 68/135] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:33 2022] GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504 => generated 1364 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:34.130068 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-321a4d82-519c-4a21-b065-91f61ab0609c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:34.143773 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-321a4d82-519c-4a21-b065-91f61ab0609c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:34.144644 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-a2f5d93b-3ad4-48a1-9afe-8c5dbb80aa85 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:34.145802 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-a2f5d93b-3ad4-48a1-9afe-8c5dbb80aa85 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] [instance: 76efde76-215b-4c32-992f-3fe518470987] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:34.150667 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-321a4d82-519c-4a21-b065-91f61ab0609c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:34.152143 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-321a4d82-519c-4a21-b065-91f61ab0609c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1599 microversion: 2.20 time: 0.272441 Jun 22 10:21:34.167667 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 68/136] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:21:33 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1599 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:21:34.176088 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-07f60921-587c-420f-8b02-25ee3a957b9a tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:34.176590 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-07f60921-587c-420f-8b02-25ee3a957b9a tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:34.177488 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a2f5d93b-3ad4-48a1-9afe-8c5dbb80aa85 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:34.178674 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a2f5d93b-3ad4-48a1-9afe-8c5dbb80aa85 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:34.179943 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a2f5d93b-3ad4-48a1-9afe-8c5dbb80aa85 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:34.181794 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a2f5d93b-3ad4-48a1-9afe-8c5dbb80aa85 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:34.207021 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-07f60921-587c-420f-8b02-25ee3a957b9a tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:34.213383 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-07f60921-587c-420f-8b02-25ee3a957b9a tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:34.214413 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-07f60921-587c-420f-8b02-25ee3a957b9a tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:34.214830 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-07f60921-587c-420f-8b02-25ee3a957b9a tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:34.673331 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-07f60921-587c-420f-8b02-25ee3a957b9a tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.501230 Jun 22 10:21:34.674134 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 69/137] 10.222.0.66 () {60 vars in 1315 bytes} [Wed Jun 22 10:21:34 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d/os-interface => generated 284 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 10:21:34.690677 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-e29bfbbf-2eb2-4aa5-98f8-c1928bb51f6f tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:34.695935 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-e29bfbbf-2eb2-4aa5-98f8-c1928bb51f6f tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: c9505087-b458-46dc-9fbb-ee4ef61decde] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:34.712544 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e29bfbbf-2eb2-4aa5-98f8-c1928bb51f6f tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:34.713299 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e29bfbbf-2eb2-4aa5-98f8-c1928bb51f6f tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:34.714688 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e29bfbbf-2eb2-4aa5-98f8-c1928bb51f6f tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:34.715562 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e29bfbbf-2eb2-4aa5-98f8-c1928bb51f6f tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:34.765758 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-a2f5d93b-3ad4-48a1-9afe-8c5dbb80aa85 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d2a62272e248d3b11aca8737e22fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e253dfe684b469383c18ff8c2a3dbd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:34.774046 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-a2f5d93b-3ad4-48a1-9afe-8c5dbb80aa85 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] 10.222.0.66 "GET /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987" status: 200 len: 1315 microversion: 2.1 time: 0.641799 Jun 22 10:21:34.774879 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 69/138] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:34 2022] GET /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987 => generated 1315 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:34.789914 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-9e3ca4db-acd8-442e-93c3-cf384b434aac tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:34.790895 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-9e3ca4db-acd8-442e-93c3-cf384b434aac tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:34.798399 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9e3ca4db-acd8-442e-93c3-cf384b434aac tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:34.799055 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9e3ca4db-acd8-442e-93c3-cf384b434aac tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:34.800661 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9e3ca4db-acd8-442e-93c3-cf384b434aac tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:34.800661 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9e3ca4db-acd8-442e-93c3-cf384b434aac tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:34.937066 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-e29bfbbf-2eb2-4aa5-98f8-c1928bb51f6f tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:34.952052 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-e29bfbbf-2eb2-4aa5-98f8-c1928bb51f6f tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde" status: 200 len: 1365 microversion: 2.1 time: 0.273987 Jun 22 10:21:34.955460 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 70/139] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:34 2022] GET /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde => generated 1365 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:35.051997 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-9e3ca4db-acd8-442e-93c3-cf384b434aac tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:35.063025 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-9e3ca4db-acd8-442e-93c3-cf384b434aac tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1322 microversion: 2.1 time: 0.286008 Jun 22 10:21:35.064515 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 70/140] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:34 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1322 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:35.147105 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-7506f555-4deb-4bae-9f5b-08c8654ca061 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:35.147462 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-7506f555-4deb-4bae-9f5b-08c8654ca061 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: da28df11-c078-43d5-81c4-e78ccf9f6504] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:35.156174 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7506f555-4deb-4bae-9f5b-08c8654ca061 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:35.156992 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7506f555-4deb-4bae-9f5b-08c8654ca061 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:35.158059 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7506f555-4deb-4bae-9f5b-08c8654ca061 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:35.158740 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7506f555-4deb-4bae-9f5b-08c8654ca061 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:35.479052 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-7506f555-4deb-4bae-9f5b-08c8654ca061 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:35.489532 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-7506f555-4deb-4bae-9f5b-08c8654ca061 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504" status: 200 len: 1364 microversion: 2.1 time: 0.345837 Jun 22 10:21:35.490866 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 71/141] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:35 2022] GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504 => generated 1364 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:21:35.792145 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-e5097c0b-16fb-4ff7-b2b5-8faec0c0697d tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:35.793034 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-e5097c0b-16fb-4ff7-b2b5-8faec0c0697d tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] [instance: 76efde76-215b-4c32-992f-3fe518470987] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:35.801769 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e5097c0b-16fb-4ff7-b2b5-8faec0c0697d tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:35.812360 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e5097c0b-16fb-4ff7-b2b5-8faec0c0697d tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:35.815176 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e5097c0b-16fb-4ff7-b2b5-8faec0c0697d tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:35.815633 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e5097c0b-16fb-4ff7-b2b5-8faec0c0697d tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:35.971509 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-4873ebab-2a56-4da7-9b7d-c3890bbdbcd2 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:35.972815 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-4873ebab-2a56-4da7-9b7d-c3890bbdbcd2 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: c9505087-b458-46dc-9fbb-ee4ef61decde] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:35.980840 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4873ebab-2a56-4da7-9b7d-c3890bbdbcd2 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:35.984015 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4873ebab-2a56-4da7-9b7d-c3890bbdbcd2 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:35.985139 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4873ebab-2a56-4da7-9b7d-c3890bbdbcd2 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:35.985877 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4873ebab-2a56-4da7-9b7d-c3890bbdbcd2 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:36.329529 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-e5097c0b-16fb-4ff7-b2b5-8faec0c0697d tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d2a62272e248d3b11aca8737e22fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e253dfe684b469383c18ff8c2a3dbd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:36.339349 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-e5097c0b-16fb-4ff7-b2b5-8faec0c0697d tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] 10.222.0.66 "GET /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987" status: 200 len: 1502 microversion: 2.1 time: 0.551130 Jun 22 10:21:36.340860 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 71/142] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:35 2022] GET /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987 => generated 1502 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:36.346909 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-8ac0cd1b-9d58-491c-907b-e464941064c7 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:36.347986 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-8ac0cd1b-9d58-491c-907b-e464941064c7 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:36.358582 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8ac0cd1b-9d58-491c-907b-e464941064c7 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:36.359598 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8ac0cd1b-9d58-491c-907b-e464941064c7 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:36.361087 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8ac0cd1b-9d58-491c-907b-e464941064c7 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:36.362124 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8ac0cd1b-9d58-491c-907b-e464941064c7 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:36.480391 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-4873ebab-2a56-4da7-9b7d-c3890bbdbcd2 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:36.490619 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-4873ebab-2a56-4da7-9b7d-c3890bbdbcd2 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde" status: 200 len: 1365 microversion: 2.1 time: 0.522885 Jun 22 10:21:36.494559 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 72/143] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:35 2022] GET /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde => generated 1365 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:21:36.504627 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-fff0af42-b7de-4f2a-907f-b4fd4bdb37a2 req-aa01f7b8-95e0-432c-a754-30004c2d091c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9505087-b458-46dc-9fbb-ee4ef61decde", "name": "network-vif-plugged", "status": "completed", "tag": "2527809f-dcc9-4a6b-88ec-69d974d132c2"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:21:36.526618 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-fff0af42-b7de-4f2a-907f-b4fd4bdb37a2 req-aa01f7b8-95e0-432c-a754-30004c2d091c service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:36.527361 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-fff0af42-b7de-4f2a-907f-b4fd4bdb37a2 req-aa01f7b8-95e0-432c-a754-30004c2d091c service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:36.549792 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-fff0af42-b7de-4f2a-907f-b4fd4bdb37a2 req-aa01f7b8-95e0-432c-a754-30004c2d091c service nova] Creating event network-vif-plugged:2527809f-dcc9-4a6b-88ec-69d974d132c2 for instance c9505087-b458-46dc-9fbb-ee4ef61decde on hv-cinder-84713 Jun 22 10:21:36.563859 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-fff0af42-b7de-4f2a-907f-b4fd4bdb37a2 req-aa01f7b8-95e0-432c-a754-30004c2d091c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067880 Jun 22 10:21:36.564482 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 73/144] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:21:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:21:36.580990 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-a641a51b-4004-4461-879c-ef745c5290a4 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:36.581874 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-a641a51b-4004-4461-879c-ef745c5290a4 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: da28df11-c078-43d5-81c4-e78ccf9f6504] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:36.597286 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a641a51b-4004-4461-879c-ef745c5290a4 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:36.597783 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a641a51b-4004-4461-879c-ef745c5290a4 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:36.603173 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a641a51b-4004-4461-879c-ef745c5290a4 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:36.604301 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a641a51b-4004-4461-879c-ef745c5290a4 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:36.617030 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-8ac0cd1b-9d58-491c-907b-e464941064c7 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:36.633918 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-8ac0cd1b-9d58-491c-907b-e464941064c7 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1322 microversion: 2.1 time: 0.288755 Jun 22 10:21:36.637224 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 72/145] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:36 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1322 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:36.809254 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-a641a51b-4004-4461-879c-ef745c5290a4 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:36.817545 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-a641a51b-4004-4461-879c-ef745c5290a4 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504" status: 200 len: 1364 microversion: 2.1 time: 0.240841 Jun 22 10:21:36.820360 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 74/146] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:36 2022] GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504 => generated 1364 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:37.303959 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-59088fe9-33ac-481e-abba-e8f8bfff2cd4 req-6cbd2b36-ba79-408a-b375-c9280a6a7a47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "755c0b10-e04a-42fa-86da-8cc65537315d", "tag": "2931da67-7e8b-43c4-9fbb-3adba1b7225a"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:21:37.326491 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-59088fe9-33ac-481e-abba-e8f8bfff2cd4 req-6cbd2b36-ba79-408a-b375-c9280a6a7a47 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:37.327475 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-59088fe9-33ac-481e-abba-e8f8bfff2cd4 req-6cbd2b36-ba79-408a-b375-c9280a6a7a47 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:37.349447 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-59088fe9-33ac-481e-abba-e8f8bfff2cd4 req-6cbd2b36-ba79-408a-b375-c9280a6a7a47 service nova] Creating event network-changed:2931da67-7e8b-43c4-9fbb-3adba1b7225a for instance 755c0b10-e04a-42fa-86da-8cc65537315d on hv-cinder-84713 Jun 22 10:21:37.375138 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-59088fe9-33ac-481e-abba-e8f8bfff2cd4 req-6cbd2b36-ba79-408a-b375-c9280a6a7a47 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074663 Jun 22 10:21:37.376101 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 73/147] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:21:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:21:37.509093 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-67cdbcdd-3a00-41cd-8b31-6fd08d220e95 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:37.510543 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-67cdbcdd-3a00-41cd-8b31-6fd08d220e95 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: c9505087-b458-46dc-9fbb-ee4ef61decde] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:37.532721 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-67cdbcdd-3a00-41cd-8b31-6fd08d220e95 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:37.533915 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-67cdbcdd-3a00-41cd-8b31-6fd08d220e95 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:37.535280 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-67cdbcdd-3a00-41cd-8b31-6fd08d220e95 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:37.536045 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-67cdbcdd-3a00-41cd-8b31-6fd08d220e95 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:37.655066 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-dd52041b-6dfc-44dd-b70d-0d5d89dd0263 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:37.656461 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-dd52041b-6dfc-44dd-b70d-0d5d89dd0263 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:37.675479 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-dd52041b-6dfc-44dd-b70d-0d5d89dd0263 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:37.678131 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-dd52041b-6dfc-44dd-b70d-0d5d89dd0263 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:37.681010 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-dd52041b-6dfc-44dd-b70d-0d5d89dd0263 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:37.682948 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-dd52041b-6dfc-44dd-b70d-0d5d89dd0263 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:37.752710 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-67cdbcdd-3a00-41cd-8b31-6fd08d220e95 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:37.764001 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-67cdbcdd-3a00-41cd-8b31-6fd08d220e95 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde" status: 200 len: 1365 microversion: 2.1 time: 0.259137 Jun 22 10:21:37.775421 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 75/148] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:37 2022] GET /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde => generated 1365 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:37.838032 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-805b7b84-f89d-4fb1-8e27-b073858b6785 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:37.840135 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-805b7b84-f89d-4fb1-8e27-b073858b6785 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: da28df11-c078-43d5-81c4-e78ccf9f6504] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:37.851274 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-805b7b84-f89d-4fb1-8e27-b073858b6785 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:37.854224 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-805b7b84-f89d-4fb1-8e27-b073858b6785 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:37.855585 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-805b7b84-f89d-4fb1-8e27-b073858b6785 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:37.857014 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-805b7b84-f89d-4fb1-8e27-b073858b6785 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:37.900754 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:SELECT=100 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:38.081438 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-dd52041b-6dfc-44dd-b70d-0d5d89dd0263 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:38.090194 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-dd52041b-6dfc-44dd-b70d-0d5d89dd0263 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1322 microversion: 2.1 time: 0.440289 Jun 22 10:21:38.091053 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 74/149] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:37 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1322 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:21:38.096378 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-34945edb-3612-4e02-93ed-f9a132474b06 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "072c7dd1-f53c-4f04-8417-8ea511804b40"}} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:21:38.097520 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-34945edb-3612-4e02-93ed-f9a132474b06 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] [instance: 76efde76-215b-4c32-992f-3fe518470987] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:38.104953 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-34945edb-3612-4e02-93ed-f9a132474b06 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:38.105738 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-34945edb-3612-4e02-93ed-f9a132474b06 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:38.106628 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-34945edb-3612-4e02-93ed-f9a132474b06 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:38.107274 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-34945edb-3612-4e02-93ed-f9a132474b06 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:38.130725 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-805b7b84-f89d-4fb1-8e27-b073858b6785 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:38.152810 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-805b7b84-f89d-4fb1-8e27-b073858b6785 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504" status: 200 len: 1364 microversion: 2.1 time: 0.318861 Jun 22 10:21:38.154249 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 76/150] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:37 2022] GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504 => generated 1364 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:38.783552 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-c696bf94-1720-4b80-b785-fc68f1fe32e9 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:38.787642 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-c696bf94-1720-4b80-b785-fc68f1fe32e9 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: c9505087-b458-46dc-9fbb-ee4ef61decde] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:38.800288 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-c696bf94-1720-4b80-b785-fc68f1fe32e9 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:38.801008 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-c696bf94-1720-4b80-b785-fc68f1fe32e9 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:38.801983 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-c696bf94-1720-4b80-b785-fc68f1fe32e9 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:38.802671 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-c696bf94-1720-4b80-b785-fc68f1fe32e9 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:38.980218 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-c696bf94-1720-4b80-b785-fc68f1fe32e9 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:38.991734 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-c696bf94-1720-4b80-b785-fc68f1fe32e9 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde" status: 200 len: 1365 microversion: 2.1 time: 0.213296 Jun 22 10:21:38.992332 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 77/151] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:38 2022] GET /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde => generated 1365 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:39.108427 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-3acfd326-6396-4c00-a74f-d93432780128 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:39.109045 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-3acfd326-6396-4c00-a74f-d93432780128 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:39.112035 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_api:SELECT=100 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:39.116499 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3acfd326-6396-4c00-a74f-d93432780128 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:39.116956 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3acfd326-6396-4c00-a74f-d93432780128 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:39.117770 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3acfd326-6396-4c00-a74f-d93432780128 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:39.118217 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3acfd326-6396-4c00-a74f-d93432780128 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:39.258236 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-3acfd326-6396-4c00-a74f-d93432780128 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:39.267011 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-3acfd326-6396-4c00-a74f-d93432780128 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1322 microversion: 2.1 time: 0.162400 Jun 22 10:21:39.267610 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 78/152] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:39 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:21:39.272212 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-f7287830-10f4-49cf-b5ac-c28a63adc7cf tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:39.272897 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-f7287830-10f4-49cf-b5ac-c28a63adc7cf tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: da28df11-c078-43d5-81c4-e78ccf9f6504] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:39.279915 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f7287830-10f4-49cf-b5ac-c28a63adc7cf tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:39.280373 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f7287830-10f4-49cf-b5ac-c28a63adc7cf tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:39.281493 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f7287830-10f4-49cf-b5ac-c28a63adc7cf tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:39.281927 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f7287830-10f4-49cf-b5ac-c28a63adc7cf tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:39.426355 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-f7287830-10f4-49cf-b5ac-c28a63adc7cf tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:39.434449 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-f7287830-10f4-49cf-b5ac-c28a63adc7cf tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504" status: 200 len: 1364 microversion: 2.1 time: 0.165837 Jun 22 10:21:39.435259 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 79/153] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:39 2022] GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504 => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:40.003072 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-b401316e-dab2-4ac2-b0a4-7ac258a576e6 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1855882152", "imageRef": "58addf50-5317-403a-beb0-4760bdbcaa13", "flavorRef": "452"}} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:21:40.056432 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.network.neutron [None req-b401316e-dab2-4ac2-b0a4-7ac258a576e6 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] validate_networks() for None {{(pid=117680) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 10:21:40.367191 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-b401316e-dab2-4ac2-b0a4-7ac258a576e6 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Flavor limits 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 10:21:40.367687 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-b401316e-dab2-4ac2-b0a4-7ac258a576e6 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Image limits 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 10:21:40.368156 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-b401316e-dab2-4ac2-b0a4-7ac258a576e6 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Flavor pref 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 10:21:40.368560 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-b401316e-dab2-4ac2-b0a4-7ac258a576e6 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Image pref 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 10:21:40.368968 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-b401316e-dab2-4ac2-b0a4-7ac258a576e6 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 10:21:40.379922 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b401316e-dab2-4ac2-b0a4-7ac258a576e6 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:40.380437 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b401316e-dab2-4ac2-b0a4-7ac258a576e6 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:40.381282 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b401316e-dab2-4ac2-b0a4-7ac258a576e6 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:40.381727 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b401316e-dab2-4ac2-b0a4-7ac258a576e6 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:40.410534 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.quota [None req-b401316e-dab2-4ac2-b0a4-7ac258a576e6 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Getting quotas for project ebe481a378f5454d975d405bc78d1203. Resources: {'instances', 'cores', 'ram'} {{(pid=117680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:21:40.415215 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.quota [None req-b401316e-dab2-4ac2-b0a4-7ac258a576e6 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Getting quotas for user 14092cdf420c419caa3c79434dee6194 and project ebe481a378f5454d975d405bc78d1203. Resources: {'instances', 'cores', 'ram'} {{(pid=117680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:21:40.427538 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-b401316e-dab2-4ac2-b0a4-7ac258a576e6 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Going to run 1 instances... {{(pid=117680) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 10:21:40.430019 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-b401316e-dab2-4ac2-b0a4-7ac258a576e6 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] [instance: c0b8e2b0-4292-43fa-8130-fa801fd2d223] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58addf50-5317-403a-beb0-4760bdbcaa13',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 10:21:40.477546 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-b401316e-dab2-4ac2-b0a4-7ac258a576e6 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.478322 Jun 22 10:21:40.478582 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 80/154] 10.222.0.66 () {60 vars in 1146 bytes} [Wed Jun 22 10:21:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 480 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 22 10:21:40.484309 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-ab625f2c-6ce7-4d3f-94ee-0c45853bdddb tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:40.485221 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-ab625f2c-6ce7-4d3f-94ee-0c45853bdddb tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: c9505087-b458-46dc-9fbb-ee4ef61decde] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:40.497006 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ab625f2c-6ce7-4d3f-94ee-0c45853bdddb tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:40.498268 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ab625f2c-6ce7-4d3f-94ee-0c45853bdddb tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:40.499872 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ab625f2c-6ce7-4d3f-94ee-0c45853bdddb tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:40.500624 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ab625f2c-6ce7-4d3f-94ee-0c45853bdddb tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:40.641407 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-ab625f2c-6ce7-4d3f-94ee-0c45853bdddb tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:40.649497 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-ab625f2c-6ce7-4d3f-94ee-0c45853bdddb tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde" status: 200 len: 1365 microversion: 2.1 time: 0.169701 Jun 22 10:21:40.650050 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 81/155] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:40 2022] GET /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde => generated 1365 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:40.654577 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-0f826f3a-9c79-436e-a352-985057233aaa tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:40.655384 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-0f826f3a-9c79-436e-a352-985057233aaa tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:40.662974 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0f826f3a-9c79-436e-a352-985057233aaa tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:40.663340 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0f826f3a-9c79-436e-a352-985057233aaa tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:40.664121 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0f826f3a-9c79-436e-a352-985057233aaa tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:40.664616 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0f826f3a-9c79-436e-a352-985057233aaa tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:40.828723 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-0f826f3a-9c79-436e-a352-985057233aaa tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:40.841098 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-0f826f3a-9c79-436e-a352-985057233aaa tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1322 microversion: 2.1 time: 0.189928 Jun 22 10:21:40.841962 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 82/156] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:40 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:40.854803 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-de617cee-b04e-4d76-9f18-c13c258f532d tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:40.855492 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-de617cee-b04e-4d76-9f18-c13c258f532d tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: da28df11-c078-43d5-81c4-e78ccf9f6504] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:40.862995 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-de617cee-b04e-4d76-9f18-c13c258f532d tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:40.863533 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-de617cee-b04e-4d76-9f18-c13c258f532d tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:40.864374 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-de617cee-b04e-4d76-9f18-c13c258f532d tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:40.864888 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-de617cee-b04e-4d76-9f18-c13c258f532d tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:40.997659 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-de617cee-b04e-4d76-9f18-c13c258f532d tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:41.005579 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-de617cee-b04e-4d76-9f18-c13c258f532d tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504" status: 200 len: 1364 microversion: 2.1 time: 0.162229 Jun 22 10:21:41.006282 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 83/157] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:40 2022] GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:41.010856 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-9d8bad0e-2e4a-4a28-b6b0-e41c231dc755 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:41.011461 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-9d8bad0e-2e4a-4a28-b6b0-e41c231dc755 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] [instance: c0b8e2b0-4292-43fa-8130-fa801fd2d223] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:41.017471 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9d8bad0e-2e4a-4a28-b6b0-e41c231dc755 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:41.017922 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9d8bad0e-2e4a-4a28-b6b0-e41c231dc755 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:41.018729 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9d8bad0e-2e4a-4a28-b6b0-e41c231dc755 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:41.019162 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9d8bad0e-2e4a-4a28-b6b0-e41c231dc755 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:41.084728 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-9d8bad0e-2e4a-4a28-b6b0-e41c231dc755 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14092cdf420c419caa3c79434dee6194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe481a378f5454d975d405bc78d1203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:41.092873 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-9d8bad0e-2e4a-4a28-b6b0-e41c231dc755 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] 10.222.0.66 "GET /compute/v2.1/servers/c0b8e2b0-4292-43fa-8130-fa801fd2d223" status: 200 len: 1219 microversion: 2.1 time: 0.085684 Jun 22 10:21:41.093458 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 84/158] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:41 2022] GET /compute/v2.1/servers/c0b8e2b0-4292-43fa-8130-fa801fd2d223 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:41.666949 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-62b49c4a-ee7a-4fa4-bef5-1730a6039843 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:41.667589 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-62b49c4a-ee7a-4fa4-bef5-1730a6039843 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: c9505087-b458-46dc-9fbb-ee4ef61decde] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:41.680540 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-62b49c4a-ee7a-4fa4-bef5-1730a6039843 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:41.680993 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-62b49c4a-ee7a-4fa4-bef5-1730a6039843 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:41.681858 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-62b49c4a-ee7a-4fa4-bef5-1730a6039843 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:41.682194 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-62b49c4a-ee7a-4fa4-bef5-1730a6039843 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:41.836719 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-62b49c4a-ee7a-4fa4-bef5-1730a6039843 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:41.844318 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-62b49c4a-ee7a-4fa4-bef5-1730a6039843 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde" status: 200 len: 1365 microversion: 2.1 time: 0.181319 Jun 22 10:21:41.854124 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 85/159] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:41 2022] GET /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde => generated 1365 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:21:41.871924 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-7aed77cf-4d67-4706-8817-2e406d0141e1 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:41.872921 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-7aed77cf-4d67-4706-8817-2e406d0141e1 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:41.879750 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7aed77cf-4d67-4706-8817-2e406d0141e1 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:41.880458 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7aed77cf-4d67-4706-8817-2e406d0141e1 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:41.881251 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7aed77cf-4d67-4706-8817-2e406d0141e1 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:41.881693 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7aed77cf-4d67-4706-8817-2e406d0141e1 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:42.029919 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-7aed77cf-4d67-4706-8817-2e406d0141e1 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:42.038077 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-7aed77cf-4d67-4706-8817-2e406d0141e1 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1322 microversion: 2.1 time: 0.182421 Jun 22 10:21:42.038678 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 86/160] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:41 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:42.043443 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-1f76a910-29c3-4501-92ea-adb0528ca1a6 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:42.044092 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-1f76a910-29c3-4501-92ea-adb0528ca1a6 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: da28df11-c078-43d5-81c4-e78ccf9f6504] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:42.050421 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1f76a910-29c3-4501-92ea-adb0528ca1a6 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:42.050943 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1f76a910-29c3-4501-92ea-adb0528ca1a6 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:42.051688 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1f76a910-29c3-4501-92ea-adb0528ca1a6 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:42.052114 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1f76a910-29c3-4501-92ea-adb0528ca1a6 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:42.200947 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-1f76a910-29c3-4501-92ea-adb0528ca1a6 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:42.208789 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-1f76a910-29c3-4501-92ea-adb0528ca1a6 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504" status: 200 len: 1549 microversion: 2.1 time: 0.168830 Jun 22 10:21:42.209405 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 87/161] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:42 2022] GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504 => generated 1549 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:42.214780 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-e878ed31-6836-4735-8633-3aae29a0e9a2 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:42.215504 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-e878ed31-6836-4735-8633-3aae29a0e9a2 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] [instance: c0b8e2b0-4292-43fa-8130-fa801fd2d223] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:42.222383 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e878ed31-6836-4735-8633-3aae29a0e9a2 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:42.222864 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e878ed31-6836-4735-8633-3aae29a0e9a2 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:42.223660 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e878ed31-6836-4735-8633-3aae29a0e9a2 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:42.224122 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e878ed31-6836-4735-8633-3aae29a0e9a2 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:42.291036 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-e878ed31-6836-4735-8633-3aae29a0e9a2 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14092cdf420c419caa3c79434dee6194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe481a378f5454d975d405bc78d1203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:42.303629 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-e878ed31-6836-4735-8633-3aae29a0e9a2 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] 10.222.0.66 "GET /compute/v2.1/servers/c0b8e2b0-4292-43fa-8130-fa801fd2d223" status: 200 len: 1219 microversion: 2.1 time: 0.093024 Jun 22 10:21:42.304244 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 88/162] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:42 2022] GET /compute/v2.1/servers/c0b8e2b0-4292-43fa-8130-fa801fd2d223 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:42.313565 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-9f1f3adc-788d-4b74-8667-1f654fbb18ef tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:42.313565 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-9f1f3adc-788d-4b74-8667-1f654fbb18ef tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: da28df11-c078-43d5-81c4-e78ccf9f6504] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:42.322268 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9f1f3adc-788d-4b74-8667-1f654fbb18ef tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:42.322962 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9f1f3adc-788d-4b74-8667-1f654fbb18ef tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:42.324066 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9f1f3adc-788d-4b74-8667-1f654fbb18ef tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:42.324608 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9f1f3adc-788d-4b74-8667-1f654fbb18ef tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:42.475693 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-9f1f3adc-788d-4b74-8667-1f654fbb18ef tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.169651 Jun 22 10:21:42.478067 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 89/163] 10.222.0.66 () {58 vars in 1274 bytes} [Wed Jun 22 10:21:42 2022] GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504/os-interface => generated 284 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:21:42.861727 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-980406cb-11b9-4fb8-ae03-690eb67a8d50 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:42.862476 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-980406cb-11b9-4fb8-ae03-690eb67a8d50 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: c9505087-b458-46dc-9fbb-ee4ef61decde] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:42.869144 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-980406cb-11b9-4fb8-ae03-690eb67a8d50 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:42.869698 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-980406cb-11b9-4fb8-ae03-690eb67a8d50 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:42.870586 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-980406cb-11b9-4fb8-ae03-690eb67a8d50 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:42.871091 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-980406cb-11b9-4fb8-ae03-690eb67a8d50 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:43.021566 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-980406cb-11b9-4fb8-ae03-690eb67a8d50 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:43.029593 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-980406cb-11b9-4fb8-ae03-690eb67a8d50 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde" status: 200 len: 1365 microversion: 2.1 time: 0.171789 Jun 22 10:21:43.030352 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 90/164] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:42 2022] GET /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:43.056455 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-930069d2-cf72-4605-9a31-cdde120c3bb1 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:43.057303 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-930069d2-cf72-4605-9a31-cdde120c3bb1 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:43.063670 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-930069d2-cf72-4605-9a31-cdde120c3bb1 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:43.064115 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-930069d2-cf72-4605-9a31-cdde120c3bb1 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:43.064880 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-930069d2-cf72-4605-9a31-cdde120c3bb1 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:43.065308 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-930069d2-cf72-4605-9a31-cdde120c3bb1 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:43.216306 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-930069d2-cf72-4605-9a31-cdde120c3bb1 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:43.225952 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-930069d2-cf72-4605-9a31-cdde120c3bb1 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1322 microversion: 2.1 time: 0.173485 Jun 22 10:21:43.230590 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 91/165] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:43 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:43.321212 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-dbf6bb8e-9d78-4337-bdc8-140db8b86e43 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:43.322117 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-dbf6bb8e-9d78-4337-bdc8-140db8b86e43 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] [instance: c0b8e2b0-4292-43fa-8130-fa801fd2d223] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:43.338479 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-dbf6bb8e-9d78-4337-bdc8-140db8b86e43 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:43.338954 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-dbf6bb8e-9d78-4337-bdc8-140db8b86e43 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:43.339748 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-dbf6bb8e-9d78-4337-bdc8-140db8b86e43 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:43.340179 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-dbf6bb8e-9d78-4337-bdc8-140db8b86e43 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:43.583076 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-34945edb-3612-4e02-93ed-f9a132474b06 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] 10.222.0.66 "POST /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.488928 Jun 22 10:21:43.584465 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 75/166] 10.222.0.66 () {60 vars in 1322 bytes} [Wed Jun 22 10:21:38 2022] POST /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987/os-volume_attachments => generated 194 bytes in 5493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:21:43.799229 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-dbf6bb8e-9d78-4337-bdc8-140db8b86e43 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14092cdf420c419caa3c79434dee6194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe481a378f5454d975d405bc78d1203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:43.811523 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-dbf6bb8e-9d78-4337-bdc8-140db8b86e43 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] 10.222.0.66 "GET /compute/v2.1/servers/c0b8e2b0-4292-43fa-8130-fa801fd2d223" status: 200 len: 1211 microversion: 2.1 time: 0.494199 Jun 22 10:21:43.822062 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 92/167] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:43 2022] GET /compute/v2.1/servers/c0b8e2b0-4292-43fa-8130-fa801fd2d223 => generated 1211 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:43.881965 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-7b0b4cd9-662d-414b-aaff-6e6d8d258eb4 req-2bf4aeb7-aaa5-4052-a8ae-2602ae0cbae7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da28df11-c078-43d5-81c4-e78ccf9f6504", "tag": "937e9931-d784-4d24-8619-009399b6a8d5"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:21:43.893651 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-7b0b4cd9-662d-414b-aaff-6e6d8d258eb4 req-2bf4aeb7-aaa5-4052-a8ae-2602ae0cbae7 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:43.894616 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-7b0b4cd9-662d-414b-aaff-6e6d8d258eb4 req-2bf4aeb7-aaa5-4052-a8ae-2602ae0cbae7 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:43.907100 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-7b0b4cd9-662d-414b-aaff-6e6d8d258eb4 req-2bf4aeb7-aaa5-4052-a8ae-2602ae0cbae7 service nova] Creating event network-changed:937e9931-d784-4d24-8619-009399b6a8d5 for instance da28df11-c078-43d5-81c4-e78ccf9f6504 on hv-cinder-84713 Jun 22 10:21:43.912932 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-7b0b4cd9-662d-414b-aaff-6e6d8d258eb4 req-2bf4aeb7-aaa5-4052-a8ae-2602ae0cbae7 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035035 Jun 22 10:21:43.914047 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 76/168] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:21:44.047432 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-a74d3f35-29f0-4245-b0d9-81cc1578b937 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:44.049271 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-a74d3f35-29f0-4245-b0d9-81cc1578b937 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: c9505087-b458-46dc-9fbb-ee4ef61decde] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:44.056788 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a74d3f35-29f0-4245-b0d9-81cc1578b937 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:44.057504 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a74d3f35-29f0-4245-b0d9-81cc1578b937 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:44.058628 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a74d3f35-29f0-4245-b0d9-81cc1578b937 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:44.059263 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a74d3f35-29f0-4245-b0d9-81cc1578b937 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:44.244786 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-4e3cbd8c-b6a3-4784-9307-0d12cf901e10 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:44.245561 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-4e3cbd8c-b6a3-4784-9307-0d12cf901e10 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:44.252646 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4e3cbd8c-b6a3-4784-9307-0d12cf901e10 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:44.253149 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4e3cbd8c-b6a3-4784-9307-0d12cf901e10 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:44.253944 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4e3cbd8c-b6a3-4784-9307-0d12cf901e10 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:44.254419 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4e3cbd8c-b6a3-4784-9307-0d12cf901e10 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:44.519017 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-a74d3f35-29f0-4245-b0d9-81cc1578b937 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:44.532712 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-a74d3f35-29f0-4245-b0d9-81cc1578b937 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde" status: 200 len: 1365 microversion: 2.1 time: 0.488892 Jun 22 10:21:44.534399 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 93/169] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:44 2022] GET /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde => generated 1365 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:44.705401 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-4e3cbd8c-b6a3-4784-9307-0d12cf901e10 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:44.714142 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-4e3cbd8c-b6a3-4784-9307-0d12cf901e10 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1322 microversion: 2.1 time: 0.474898 Jun 22 10:21:44.714846 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 77/170] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:44 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1322 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:21:44.832836 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-636a5e27-7da7-4a29-b41a-593a212f9885 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:44.833718 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-636a5e27-7da7-4a29-b41a-593a212f9885 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] [instance: c0b8e2b0-4292-43fa-8130-fa801fd2d223] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:44.841468 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-636a5e27-7da7-4a29-b41a-593a212f9885 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:44.842268 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-636a5e27-7da7-4a29-b41a-593a212f9885 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:44.843642 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-636a5e27-7da7-4a29-b41a-593a212f9885 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:44.844302 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-636a5e27-7da7-4a29-b41a-593a212f9885 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:44.849146 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:SELECT=100 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:44.991224 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-bc5db4a6-4c52-42a3-bf99-5810139bca18 req-fdf6ab15-8b56-42c8-b87a-9802527df7db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74f2497c-d91a-47be-b505-090e99ab9c52", "name": "network-vif-plugged", "status": "completed", "tag": "2c6f6652-0c2f-4ac8-85d8-e42607054324"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:21:45.005963 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-bc5db4a6-4c52-42a3-bf99-5810139bca18 req-fdf6ab15-8b56-42c8-b87a-9802527df7db service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:45.006410 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-bc5db4a6-4c52-42a3-bf99-5810139bca18 req-fdf6ab15-8b56-42c8-b87a-9802527df7db service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:45.042122 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-bc5db4a6-4c52-42a3-bf99-5810139bca18 req-fdf6ab15-8b56-42c8-b87a-9802527df7db service nova] Creating event network-vif-plugged:2c6f6652-0c2f-4ac8-85d8-e42607054324 for instance 74f2497c-d91a-47be-b505-090e99ab9c52 on hv-cinder-84713 Jun 22 10:21:45.062196 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-bc5db4a6-4c52-42a3-bf99-5810139bca18 req-fdf6ab15-8b56-42c8-b87a-9802527df7db service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074205 Jun 22 10:21:45.062196 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 78/171] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:21:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:21:45.214215 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-636a5e27-7da7-4a29-b41a-593a212f9885 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14092cdf420c419caa3c79434dee6194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe481a378f5454d975d405bc78d1203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:45.236245 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-636a5e27-7da7-4a29-b41a-593a212f9885 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] 10.222.0.66 "GET /compute/v2.1/servers/c0b8e2b0-4292-43fa-8130-fa801fd2d223" status: 200 len: 1273 microversion: 2.1 time: 0.410498 Jun 22 10:21:45.236858 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 94/172] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:44 2022] GET /compute/v2.1/servers/c0b8e2b0-4292-43fa-8130-fa801fd2d223 => generated 1273 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:45.553668 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-8497da8a-fafd-4c5d-872e-33a59a4b1d60 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:45.554370 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-8497da8a-fafd-4c5d-872e-33a59a4b1d60 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: c9505087-b458-46dc-9fbb-ee4ef61decde] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:45.564631 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8497da8a-fafd-4c5d-872e-33a59a4b1d60 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:45.565462 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8497da8a-fafd-4c5d-872e-33a59a4b1d60 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:45.566490 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8497da8a-fafd-4c5d-872e-33a59a4b1d60 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:45.567294 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8497da8a-fafd-4c5d-872e-33a59a4b1d60 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:45.735236 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-1f6b8d19-ad58-4ce9-98b0-c3e09eef005a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:45.736892 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-1f6b8d19-ad58-4ce9-98b0-c3e09eef005a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:45.747650 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1f6b8d19-ad58-4ce9-98b0-c3e09eef005a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:45.749203 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1f6b8d19-ad58-4ce9-98b0-c3e09eef005a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:45.750429 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1f6b8d19-ad58-4ce9-98b0-c3e09eef005a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:45.753125 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1f6b8d19-ad58-4ce9-98b0-c3e09eef005a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:45.754313 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-8497da8a-fafd-4c5d-872e-33a59a4b1d60 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:45.769023 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-8497da8a-fafd-4c5d-872e-33a59a4b1d60 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde" status: 200 len: 1365 microversion: 2.1 time: 0.221390 Jun 22 10:21:45.782603 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 79/173] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:45 2022] GET /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde => generated 1365 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:45.967100 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-1f6b8d19-ad58-4ce9-98b0-c3e09eef005a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:45.975956 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-1f6b8d19-ad58-4ce9-98b0-c3e09eef005a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1322 microversion: 2.1 time: 0.246480 Jun 22 10:21:45.976774 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 95/174] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:45 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1322 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:46.254110 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-2c623c39-c5e8-4f59-9e9e-2bf9578c4888 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:46.255146 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-2c623c39-c5e8-4f59-9e9e-2bf9578c4888 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] [instance: c0b8e2b0-4292-43fa-8130-fa801fd2d223] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:46.265262 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2c623c39-c5e8-4f59-9e9e-2bf9578c4888 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:46.266063 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2c623c39-c5e8-4f59-9e9e-2bf9578c4888 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:46.267256 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2c623c39-c5e8-4f59-9e9e-2bf9578c4888 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:46.268036 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2c623c39-c5e8-4f59-9e9e-2bf9578c4888 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:46.432510 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-2c623c39-c5e8-4f59-9e9e-2bf9578c4888 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14092cdf420c419caa3c79434dee6194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe481a378f5454d975d405bc78d1203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:46.447944 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-2c623c39-c5e8-4f59-9e9e-2bf9578c4888 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] 10.222.0.66 "GET /compute/v2.1/servers/c0b8e2b0-4292-43fa-8130-fa801fd2d223" status: 200 len: 1273 microversion: 2.1 time: 0.198190 Jun 22 10:21:46.448724 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 80/175] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:46 2022] GET /compute/v2.1/servers/c0b8e2b0-4292-43fa-8130-fa801fd2d223 => generated 1273 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:46.787601 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-7abed08b-1e44-45b9-81ab-add4987a0769 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:46.788247 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-7abed08b-1e44-45b9-81ab-add4987a0769 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: c9505087-b458-46dc-9fbb-ee4ef61decde] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:46.797173 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7abed08b-1e44-45b9-81ab-add4987a0769 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:46.797825 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7abed08b-1e44-45b9-81ab-add4987a0769 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:46.802405 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7abed08b-1e44-45b9-81ab-add4987a0769 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:46.803045 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7abed08b-1e44-45b9-81ab-add4987a0769 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:47.003358 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-e4c94937-3497-4c9f-9add-682bd4c661c2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:47.004976 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-e4c94937-3497-4c9f-9add-682bd4c661c2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:47.019500 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e4c94937-3497-4c9f-9add-682bd4c661c2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:47.020342 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e4c94937-3497-4c9f-9add-682bd4c661c2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:47.021547 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e4c94937-3497-4c9f-9add-682bd4c661c2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:47.022216 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e4c94937-3497-4c9f-9add-682bd4c661c2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:47.023365 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-7abed08b-1e44-45b9-81ab-add4987a0769 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:47.034068 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-7abed08b-1e44-45b9-81ab-add4987a0769 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde" status: 200 len: 1365 microversion: 2.1 time: 0.250327 Jun 22 10:21:47.035301 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 96/176] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:46 2022] GET /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde => generated 1365 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:47.213997 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-e4c94937-3497-4c9f-9add-682bd4c661c2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:47.222748 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-e4c94937-3497-4c9f-9add-682bd4c661c2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1322 microversion: 2.1 time: 0.228477 Jun 22 10:21:47.223227 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 81/177] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:46 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1322 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:47.465153 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-ae1a45e7-4059-4b60-87c3-bf3126bb6eef tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:47.466372 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-ae1a45e7-4059-4b60-87c3-bf3126bb6eef tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] [instance: c0b8e2b0-4292-43fa-8130-fa801fd2d223] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:47.474466 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ae1a45e7-4059-4b60-87c3-bf3126bb6eef tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:47.475267 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ae1a45e7-4059-4b60-87c3-bf3126bb6eef tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:47.479772 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ae1a45e7-4059-4b60-87c3-bf3126bb6eef tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:47.480489 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ae1a45e7-4059-4b60-87c3-bf3126bb6eef tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:47.713764 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-ae1a45e7-4059-4b60-87c3-bf3126bb6eef tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14092cdf420c419caa3c79434dee6194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe481a378f5454d975d405bc78d1203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:47.721590 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-ae1a45e7-4059-4b60-87c3-bf3126bb6eef tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] 10.222.0.66 "GET /compute/v2.1/servers/c0b8e2b0-4292-43fa-8130-fa801fd2d223" status: 200 len: 1315 microversion: 2.1 time: 0.260807 Jun 22 10:21:47.722282 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 97/178] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:47 2022] GET /compute/v2.1/servers/c0b8e2b0-4292-43fa-8130-fa801fd2d223 => generated 1315 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:48.052993 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-24ab8622-af67-4893-bb79-678604fe149c tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:48.053630 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-24ab8622-af67-4893-bb79-678604fe149c tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: c9505087-b458-46dc-9fbb-ee4ef61decde] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:48.060902 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-24ab8622-af67-4893-bb79-678604fe149c tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:48.061347 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-24ab8622-af67-4893-bb79-678604fe149c tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:48.062104 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-24ab8622-af67-4893-bb79-678604fe149c tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:48.062655 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-24ab8622-af67-4893-bb79-678604fe149c tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:48.078319 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:48.213273 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-24ab8622-af67-4893-bb79-678604fe149c tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:48.223858 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-24ab8622-af67-4893-bb79-678604fe149c tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde" status: 200 len: 1555 microversion: 2.1 time: 0.175410 Jun 22 10:21:48.224516 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 82/179] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:48 2022] GET /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde => generated 1555 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:48.244939 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-ce206e48-7f42-4cf1-9a9f-1cea3a5e803d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:48.245962 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-ce206e48-7f42-4cf1-9a9f-1cea3a5e803d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:48.254748 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-8f8ebede-2886-41eb-820c-b81e6bfc4796 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:48.254992 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ce206e48-7f42-4cf1-9a9f-1cea3a5e803d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:48.255551 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ce206e48-7f42-4cf1-9a9f-1cea3a5e803d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:48.255852 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-8f8ebede-2886-41eb-820c-b81e6bfc4796 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: c9505087-b458-46dc-9fbb-ee4ef61decde] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:48.256545 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ce206e48-7f42-4cf1-9a9f-1cea3a5e803d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:48.257145 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ce206e48-7f42-4cf1-9a9f-1cea3a5e803d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:48.266069 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8f8ebede-2886-41eb-820c-b81e6bfc4796 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:48.266565 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8f8ebede-2886-41eb-820c-b81e6bfc4796 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:48.268935 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8f8ebede-2886-41eb-820c-b81e6bfc4796 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:48.269723 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8f8ebede-2886-41eb-820c-b81e6bfc4796 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:48.402624 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-8f8ebede-2886-41eb-820c-b81e6bfc4796 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.157917 Jun 22 10:21:48.403606 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 83/180] 10.222.0.66 () {58 vars in 1274 bytes} [Wed Jun 22 10:21:48 2022] GET /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde/os-interface => generated 284 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:21:48.739633 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-4c283aa4-c8f5-49c2-9811-cbae9db52af7 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:48.740778 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-4c283aa4-c8f5-49c2-9811-cbae9db52af7 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] [instance: c0b8e2b0-4292-43fa-8130-fa801fd2d223] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:48.748706 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4c283aa4-c8f5-49c2-9811-cbae9db52af7 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:48.749511 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4c283aa4-c8f5-49c2-9811-cbae9db52af7 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:48.750386 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4c283aa4-c8f5-49c2-9811-cbae9db52af7 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:48.751079 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4c283aa4-c8f5-49c2-9811-cbae9db52af7 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:48.950782 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-ce206e48-7f42-4cf1-9a9f-1cea3a5e803d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:48.960327 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-ce206e48-7f42-4cf1-9a9f-1cea3a5e803d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1322 microversion: 2.1 time: 0.722931 Jun 22 10:21:48.960959 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 98/181] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:48 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1322 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:49.491835 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-bb60abb8-4bf8-4b11-ad16-61164a061d0d req-caf43293-5924-4bfc-9a56-ec0bb0692a42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0b8e2b0-4292-43fa-8130-fa801fd2d223", "tag": "503104fd-bfc6-4360-9f0e-8d9c5f6d3feb"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:21:49.509148 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-bb60abb8-4bf8-4b11-ad16-61164a061d0d req-caf43293-5924-4bfc-9a56-ec0bb0692a42 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:49.509586 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-bb60abb8-4bf8-4b11-ad16-61164a061d0d req-caf43293-5924-4bfc-9a56-ec0bb0692a42 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:49.526540 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-bb60abb8-4bf8-4b11-ad16-61164a061d0d req-caf43293-5924-4bfc-9a56-ec0bb0692a42 service nova] Creating event network-changed:503104fd-bfc6-4360-9f0e-8d9c5f6d3feb for instance c0b8e2b0-4292-43fa-8130-fa801fd2d223 on hv-cinder-84713 Jun 22 10:21:49.533565 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-bb60abb8-4bf8-4b11-ad16-61164a061d0d req-caf43293-5924-4bfc-9a56-ec0bb0692a42 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045749 Jun 22 10:21:49.534843 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 99/182] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:21:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:21:49.610699 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-4c283aa4-c8f5-49c2-9811-cbae9db52af7 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14092cdf420c419caa3c79434dee6194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe481a378f5454d975d405bc78d1203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:49.629939 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-4c283aa4-c8f5-49c2-9811-cbae9db52af7 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] 10.222.0.66 "GET /compute/v2.1/servers/c0b8e2b0-4292-43fa-8130-fa801fd2d223" status: 200 len: 1315 microversion: 2.1 time: 0.895100 Jun 22 10:21:49.631284 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 84/183] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:48 2022] GET /compute/v2.1/servers/c0b8e2b0-4292-43fa-8130-fa801fd2d223 => generated 1315 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:49.977909 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-fc1d02bf-da86-461c-979f-31d5c1b19c1e tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:49.978698 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-fc1d02bf-da86-461c-979f-31d5c1b19c1e tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:49.989259 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fc1d02bf-da86-461c-979f-31d5c1b19c1e tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:49.989732 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fc1d02bf-da86-461c-979f-31d5c1b19c1e tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:49.990602 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fc1d02bf-da86-461c-979f-31d5c1b19c1e tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:49.991056 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fc1d02bf-da86-461c-979f-31d5c1b19c1e tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:50.369766 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-fc1d02bf-da86-461c-979f-31d5c1b19c1e tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:50.385434 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-fc1d02bf-da86-461c-979f-31d5c1b19c1e tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1515 microversion: 2.1 time: 0.411733 Jun 22 10:21:50.397499 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 100/184] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:49 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1515 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:50.403457 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-d0eb7e75-9cad-405e-b869-b4fe3ecad09e tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:21:50.404773 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-d0eb7e75-9cad-405e-b869-b4fe3ecad09e tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:50.412229 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d0eb7e75-9cad-405e-b869-b4fe3ecad09e tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:50.412665 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d0eb7e75-9cad-405e-b869-b4fe3ecad09e tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:50.414089 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d0eb7e75-9cad-405e-b869-b4fe3ecad09e tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:50.415058 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d0eb7e75-9cad-405e-b869-b4fe3ecad09e tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:50.440636 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.objects.instance [None req-d0eb7e75-9cad-405e-b869-b4fe3ecad09e tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lazy-loading 'flavor' on Instance uuid 74f2497c-d91a-47be-b505-090e99ab9c52 {{(pid=117679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:21:50.607842 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-d0eb7e75-9cad-405e-b869-b4fe3ecad09e tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "POST /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52/action" status: 200 len: 32 microversion: 2.1 time: 0.208500 Jun 22 10:21:50.614390 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 85/185] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Jun 22 10:21:50 2022] POST /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52/action => generated 32 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 22 10:21:50.620196 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell0:SELECT=2 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:50.621454 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell0:SELECT=6 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:50.626672 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-e3560e00-c8c6-4e29-83e6-dba2e938bd16 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:50.627567 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-e3560e00-c8c6-4e29-83e6-dba2e938bd16 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:50.642296 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e3560e00-c8c6-4e29-83e6-dba2e938bd16 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:50.647536 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e3560e00-c8c6-4e29-83e6-dba2e938bd16 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:50.648613 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-eaada9a5-0b18-4fbc-9983-df9aad9b7f24 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:50.649340 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-eaada9a5-0b18-4fbc-9983-df9aad9b7f24 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] [instance: c0b8e2b0-4292-43fa-8130-fa801fd2d223] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:50.649605 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e3560e00-c8c6-4e29-83e6-dba2e938bd16 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:50.650237 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e3560e00-c8c6-4e29-83e6-dba2e938bd16 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:50.664324 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-eaada9a5-0b18-4fbc-9983-df9aad9b7f24 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:50.664792 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-eaada9a5-0b18-4fbc-9983-df9aad9b7f24 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:50.665682 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-eaada9a5-0b18-4fbc-9983-df9aad9b7f24 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:50.666123 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-eaada9a5-0b18-4fbc-9983-df9aad9b7f24 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:51.149724 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-eaada9a5-0b18-4fbc-9983-df9aad9b7f24 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14092cdf420c419caa3c79434dee6194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe481a378f5454d975d405bc78d1203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:51.160069 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-eaada9a5-0b18-4fbc-9983-df9aad9b7f24 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] 10.222.0.66 "GET /compute/v2.1/servers/c0b8e2b0-4292-43fa-8130-fa801fd2d223" status: 200 len: 1315 microversion: 2.1 time: 0.515952 Jun 22 10:21:51.161066 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 86/186] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:50 2022] GET /compute/v2.1/servers/c0b8e2b0-4292-43fa-8130-fa801fd2d223 => generated 1315 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:21:51.173659 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-e3560e00-c8c6-4e29-83e6-dba2e938bd16 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:51.183547 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-e3560e00-c8c6-4e29-83e6-dba2e938bd16 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1521 microversion: 2.1 time: 0.564096 Jun 22 10:21:51.184477 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 101/187] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:50 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1521 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:51.274376 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-9d4142a5-82b9-4eff-b1d5-29dff9ff01b1 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1183395731", "imageRef": "58addf50-5317-403a-beb0-4760bdbcaa13", "flavorRef": "452", "networks": [{"uuid": "44cd5c0c-cb86-4f23-8ca9-182c70ed950d"}]}} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:21:51.333586 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.network.neutron [None req-9d4142a5-82b9-4eff-b1d5-29dff9ff01b1 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] validate_networks() for [('44cd5c0c-cb86-4f23-8ca9-182c70ed950d', None, None, None, None, None)] {{(pid=117679) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 10:21:51.337847 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-9b9ea7d5-326e-488a-9700-4b6c4531f0bc req-c8d05b12-6591-471c-a5a9-7af7b2a2b344 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9505087-b458-46dc-9fbb-ee4ef61decde", "tag": "2527809f-dcc9-4a6b-88ec-69d974d132c2"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:21:51.344209 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-9b9ea7d5-326e-488a-9700-4b6c4531f0bc req-c8d05b12-6591-471c-a5a9-7af7b2a2b344 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:51.344787 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-9b9ea7d5-326e-488a-9700-4b6c4531f0bc req-c8d05b12-6591-471c-a5a9-7af7b2a2b344 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:51.358786 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-9b9ea7d5-326e-488a-9700-4b6c4531f0bc req-c8d05b12-6591-471c-a5a9-7af7b2a2b344 service nova] Creating event network-changed:2527809f-dcc9-4a6b-88ec-69d974d132c2 for instance c9505087-b458-46dc-9fbb-ee4ef61decde on hv-cinder-84713 Jun 22 10:21:51.365107 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-9b9ea7d5-326e-488a-9700-4b6c4531f0bc req-c8d05b12-6591-471c-a5a9-7af7b2a2b344 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033172 Jun 22 10:21:51.365876 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 102/188] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:21:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:21:51.765637 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-9d4142a5-82b9-4eff-b1d5-29dff9ff01b1 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Flavor limits 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 10:21:51.766188 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-9d4142a5-82b9-4eff-b1d5-29dff9ff01b1 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Image limits 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 10:21:51.766693 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-9d4142a5-82b9-4eff-b1d5-29dff9ff01b1 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Flavor pref 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 10:21:51.767168 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-9d4142a5-82b9-4eff-b1d5-29dff9ff01b1 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Image pref 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 10:21:51.767659 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-9d4142a5-82b9-4eff-b1d5-29dff9ff01b1 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 10:21:51.781784 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9d4142a5-82b9-4eff-b1d5-29dff9ff01b1 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:51.782718 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9d4142a5-82b9-4eff-b1d5-29dff9ff01b1 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:51.783686 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9d4142a5-82b9-4eff-b1d5-29dff9ff01b1 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:51.784494 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9d4142a5-82b9-4eff-b1d5-29dff9ff01b1 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:51.802833 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.quota [None req-9d4142a5-82b9-4eff-b1d5-29dff9ff01b1 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Getting quotas for project c5370eb5245247a68d7f224cdd457ea1. Resources: {'instances', 'cores', 'ram'} {{(pid=117679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:21:51.808002 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.quota [None req-9d4142a5-82b9-4eff-b1d5-29dff9ff01b1 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Getting quotas for user 0d1dcf4b8dbb4e1698e7b0c4dc9c63a4 and project c5370eb5245247a68d7f224cdd457ea1. Resources: {'instances', 'cores', 'ram'} {{(pid=117679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:21:51.820688 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-9d4142a5-82b9-4eff-b1d5-29dff9ff01b1 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Going to run 1 instances... {{(pid=117679) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 10:21:51.823335 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-9d4142a5-82b9-4eff-b1d5-29dff9ff01b1 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 737e0985-7e40-4d2b-ad8e-81dbf965e1e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58addf50-5317-403a-beb0-4760bdbcaa13',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 10:21:51.876391 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-9d4142a5-82b9-4eff-b1d5-29dff9ff01b1 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.604834 Jun 22 10:21:51.876391 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 87/189] 10.222.0.66 () {60 vars in 1146 bytes} [Wed Jun 22 10:21:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 10:21:51.887162 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-abdb6083-08b7-4c24-82b4-4fe45edf5448 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:51.888526 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-abdb6083-08b7-4c24-82b4-4fe45edf5448 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 737e0985-7e40-4d2b-ad8e-81dbf965e1e3] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:51.973814 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-abdb6083-08b7-4c24-82b4-4fe45edf5448 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5370eb5245247a68d7f224cdd457ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:51.982497 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-abdb6083-08b7-4c24-82b4-4fe45edf5448 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3" status: 200 len: 1214 microversion: 2.1 time: 0.099691 Jun 22 10:21:51.983477 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 103/190] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:51 2022] GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3 => generated 1214 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:21:52.184045 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-c1048ce0-763c-4bc2-9448-9b0dbd84f92c tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:52.185172 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-c1048ce0-763c-4bc2-9448-9b0dbd84f92c tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] [instance: c0b8e2b0-4292-43fa-8130-fa801fd2d223] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:52.195554 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c1048ce0-763c-4bc2-9448-9b0dbd84f92c tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:52.197578 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c1048ce0-763c-4bc2-9448-9b0dbd84f92c tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:52.199367 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c1048ce0-763c-4bc2-9448-9b0dbd84f92c tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:52.200499 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c1048ce0-763c-4bc2-9448-9b0dbd84f92c tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:52.207081 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-8650c42b-495c-429a-b766-ec026507fd25 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:52.208213 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-8650c42b-495c-429a-b766-ec026507fd25 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:52.250641 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8650c42b-495c-429a-b766-ec026507fd25 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:52.251458 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8650c42b-495c-429a-b766-ec026507fd25 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:52.252986 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8650c42b-495c-429a-b766-ec026507fd25 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:52.253781 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8650c42b-495c-429a-b766-ec026507fd25 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:52.531776 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-c1048ce0-763c-4bc2-9448-9b0dbd84f92c tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14092cdf420c419caa3c79434dee6194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe481a378f5454d975d405bc78d1203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:52.545290 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-c1048ce0-763c-4bc2-9448-9b0dbd84f92c tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] 10.222.0.66 "GET /compute/v2.1/servers/c0b8e2b0-4292-43fa-8130-fa801fd2d223" status: 200 len: 1315 microversion: 2.1 time: 0.367980 Jun 22 10:21:52.553126 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-8650c42b-495c-429a-b766-ec026507fd25 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:52.555305 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 88/191] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:52 2022] GET /compute/v2.1/servers/c0b8e2b0-4292-43fa-8130-fa801fd2d223 => generated 1315 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:52.566119 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-8650c42b-495c-429a-b766-ec026507fd25 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1521 microversion: 2.1 time: 0.367212 Jun 22 10:21:52.567590 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 104/192] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:52 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1521 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:21:53.000729 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-f83bcc82-d664-44bc-955f-f71a5d7dc851 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:53.001342 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-f83bcc82-d664-44bc-955f-f71a5d7dc851 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 737e0985-7e40-4d2b-ad8e-81dbf965e1e3] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:53.008399 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f83bcc82-d664-44bc-955f-f71a5d7dc851 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:53.008849 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f83bcc82-d664-44bc-955f-f71a5d7dc851 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:53.009631 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f83bcc82-d664-44bc-955f-f71a5d7dc851 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:53.010062 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f83bcc82-d664-44bc-955f-f71a5d7dc851 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:53.077600 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-f83bcc82-d664-44bc-955f-f71a5d7dc851 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5370eb5245247a68d7f224cdd457ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:53.085611 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-f83bcc82-d664-44bc-955f-f71a5d7dc851 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3" status: 200 len: 1218 microversion: 2.1 time: 0.088747 Jun 22 10:21:53.086354 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 89/193] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:52 2022] GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:53.563627 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-77113b08-49b9-4267-9c95-b0b53f4f9e6c tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:53.564259 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-77113b08-49b9-4267-9c95-b0b53f4f9e6c tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] [instance: c0b8e2b0-4292-43fa-8130-fa801fd2d223] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:53.570869 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-77113b08-49b9-4267-9c95-b0b53f4f9e6c tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:53.571306 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-77113b08-49b9-4267-9c95-b0b53f4f9e6c tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:53.572066 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-77113b08-49b9-4267-9c95-b0b53f4f9e6c tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:53.572661 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-77113b08-49b9-4267-9c95-b0b53f4f9e6c tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:53.586777 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-eb2605c8-7d3a-439d-b3ab-028e79b71910 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:53.587443 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-eb2605c8-7d3a-439d-b3ab-028e79b71910 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:53.596579 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-eb2605c8-7d3a-439d-b3ab-028e79b71910 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:53.597082 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-eb2605c8-7d3a-439d-b3ab-028e79b71910 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:53.597850 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-eb2605c8-7d3a-439d-b3ab-028e79b71910 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:53.598319 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-eb2605c8-7d3a-439d-b3ab-028e79b71910 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:53.785885 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-77113b08-49b9-4267-9c95-b0b53f4f9e6c tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14092cdf420c419caa3c79434dee6194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe481a378f5454d975d405bc78d1203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:53.789103 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-eb2605c8-7d3a-439d-b3ab-028e79b71910 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:53.793637 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-77113b08-49b9-4267-9c95-b0b53f4f9e6c tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] 10.222.0.66 "GET /compute/v2.1/servers/c0b8e2b0-4292-43fa-8130-fa801fd2d223" status: 200 len: 1315 microversion: 2.1 time: 0.233993 Jun 22 10:21:53.794437 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 105/194] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:53 2022] GET /compute/v2.1/servers/c0b8e2b0-4292-43fa-8130-fa801fd2d223 => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:53.797230 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-eb2605c8-7d3a-439d-b3ab-028e79b71910 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1521 microversion: 2.1 time: 0.214738 Jun 22 10:21:53.797793 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 90/195] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:53 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:21:54.103051 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-0bc9b9d6-3a97-4da8-b7aa-4ee84f22506c tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:54.103609 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-0bc9b9d6-3a97-4da8-b7aa-4ee84f22506c tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 737e0985-7e40-4d2b-ad8e-81dbf965e1e3] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:54.110096 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0bc9b9d6-3a97-4da8-b7aa-4ee84f22506c tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:54.110566 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0bc9b9d6-3a97-4da8-b7aa-4ee84f22506c tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:54.111358 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0bc9b9d6-3a97-4da8-b7aa-4ee84f22506c tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:54.111800 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0bc9b9d6-3a97-4da8-b7aa-4ee84f22506c tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:54.174458 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-0bc9b9d6-3a97-4da8-b7aa-4ee84f22506c tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5370eb5245247a68d7f224cdd457ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:54.182196 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-0bc9b9d6-3a97-4da8-b7aa-4ee84f22506c tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3" status: 200 len: 1218 microversion: 2.1 time: 0.083094 Jun 22 10:21:54.182827 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 106/196] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:54 2022] GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:54.811976 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-49edfa0a-64c1-40f3-ae1a-1e670fdc11ac tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:54.812457 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-49edfa0a-64c1-40f3-ae1a-1e670fdc11ac tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] [instance: c0b8e2b0-4292-43fa-8130-fa801fd2d223] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:54.813588 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-73087b7e-340f-4dae-9b6b-0f2e0b043750 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:54.814405 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-73087b7e-340f-4dae-9b6b-0f2e0b043750 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:54.819796 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-49edfa0a-64c1-40f3-ae1a-1e670fdc11ac tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:54.820255 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-49edfa0a-64c1-40f3-ae1a-1e670fdc11ac tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:54.820672 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-73087b7e-340f-4dae-9b6b-0f2e0b043750 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:54.821042 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-49edfa0a-64c1-40f3-ae1a-1e670fdc11ac tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:54.821181 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-73087b7e-340f-4dae-9b6b-0f2e0b043750 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:54.821481 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-49edfa0a-64c1-40f3-ae1a-1e670fdc11ac tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:54.821878 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-73087b7e-340f-4dae-9b6b-0f2e0b043750 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:54.822330 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-73087b7e-340f-4dae-9b6b-0f2e0b043750 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:55.037719 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-73087b7e-340f-4dae-9b6b-0f2e0b043750 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:55.041109 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-49edfa0a-64c1-40f3-ae1a-1e670fdc11ac tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14092cdf420c419caa3c79434dee6194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe481a378f5454d975d405bc78d1203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:55.046231 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-73087b7e-340f-4dae-9b6b-0f2e0b043750 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1521 microversion: 2.1 time: 0.236931 Jun 22 10:21:55.046857 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 107/197] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:54 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:55.049042 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-49edfa0a-64c1-40f3-ae1a-1e670fdc11ac tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] 10.222.0.66 "GET /compute/v2.1/servers/c0b8e2b0-4292-43fa-8130-fa801fd2d223" status: 200 len: 1315 microversion: 2.1 time: 0.241971 Jun 22 10:21:55.049657 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 91/198] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:54 2022] GET /compute/v2.1/servers/c0b8e2b0-4292-43fa-8130-fa801fd2d223 => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:55.200210 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-3ac7bca1-1ab4-4943-beb1-b755fcbc25f2 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:55.200738 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-3ac7bca1-1ab4-4943-beb1-b755fcbc25f2 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 737e0985-7e40-4d2b-ad8e-81dbf965e1e3] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:55.207607 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3ac7bca1-1ab4-4943-beb1-b755fcbc25f2 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:55.208058 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3ac7bca1-1ab4-4943-beb1-b755fcbc25f2 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:55.208841 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3ac7bca1-1ab4-4943-beb1-b755fcbc25f2 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:55.209281 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3ac7bca1-1ab4-4943-beb1-b755fcbc25f2 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:55.272179 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-3ac7bca1-1ab4-4943-beb1-b755fcbc25f2 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5370eb5245247a68d7f224cdd457ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:55.280287 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-3ac7bca1-1ab4-4943-beb1-b755fcbc25f2 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3" status: 200 len: 1218 microversion: 2.1 time: 0.084036 Jun 22 10:21:55.281262 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 108/199] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:55 2022] GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:56.068952 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-011e9d75-6f80-4e47-a781-971ca05c950a tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:56.069525 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-011e9d75-6f80-4e47-a781-971ca05c950a tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] [instance: c0b8e2b0-4292-43fa-8130-fa801fd2d223] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:56.070915 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-d642bdea-536d-4d44-a481-860c8b42e176 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:56.071459 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-d642bdea-536d-4d44-a481-860c8b42e176 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:56.076302 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-011e9d75-6f80-4e47-a781-971ca05c950a tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:56.076755 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-011e9d75-6f80-4e47-a781-971ca05c950a tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:56.077531 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-011e9d75-6f80-4e47-a781-971ca05c950a tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:56.077687 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d642bdea-536d-4d44-a481-860c8b42e176 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:56.077972 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-011e9d75-6f80-4e47-a781-971ca05c950a tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:56.078130 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d642bdea-536d-4d44-a481-860c8b42e176 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:56.078926 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d642bdea-536d-4d44-a481-860c8b42e176 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:56.079361 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d642bdea-536d-4d44-a481-860c8b42e176 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:56.273525 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-d642bdea-536d-4d44-a481-860c8b42e176 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:56.276713 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-011e9d75-6f80-4e47-a781-971ca05c950a tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14092cdf420c419caa3c79434dee6194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe481a378f5454d975d405bc78d1203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:56.282199 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-d642bdea-536d-4d44-a481-860c8b42e176 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1521 microversion: 2.1 time: 0.215064 Jun 22 10:21:56.282869 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 109/200] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:56 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:56.285245 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-011e9d75-6f80-4e47-a781-971ca05c950a tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] 10.222.0.66 "GET /compute/v2.1/servers/c0b8e2b0-4292-43fa-8130-fa801fd2d223" status: 200 len: 1315 microversion: 2.1 time: 0.220278 Jun 22 10:21:56.285830 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 92/201] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:56 2022] GET /compute/v2.1/servers/c0b8e2b0-4292-43fa-8130-fa801fd2d223 => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:56.297243 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-37194577-30a4-4d39-bc9c-338972d37191 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:56.297949 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-37194577-30a4-4d39-bc9c-338972d37191 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 737e0985-7e40-4d2b-ad8e-81dbf965e1e3] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:56.305155 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-37194577-30a4-4d39-bc9c-338972d37191 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:56.305677 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-37194577-30a4-4d39-bc9c-338972d37191 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:56.306580 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-37194577-30a4-4d39-bc9c-338972d37191 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:56.307054 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-37194577-30a4-4d39-bc9c-338972d37191 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:56.374353 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-37194577-30a4-4d39-bc9c-338972d37191 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5370eb5245247a68d7f224cdd457ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:56.382799 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-37194577-30a4-4d39-bc9c-338972d37191 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3" status: 200 len: 1218 microversion: 2.1 time: 0.089226 Jun 22 10:21:56.383346 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 110/202] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:56 2022] GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3 => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:57.301534 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-eb267fc9-954b-45a7-b191-52e2da9eb793 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:57.302142 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-eb267fc9-954b-45a7-b191-52e2da9eb793 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:57.302677 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-17c8d344-1902-4a8d-8743-2fe6ff9890d0 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:57.303296 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-17c8d344-1902-4a8d-8743-2fe6ff9890d0 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] [instance: c0b8e2b0-4292-43fa-8130-fa801fd2d223] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:57.309421 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-eb267fc9-954b-45a7-b191-52e2da9eb793 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:57.309863 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-eb267fc9-954b-45a7-b191-52e2da9eb793 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:57.310000 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-17c8d344-1902-4a8d-8743-2fe6ff9890d0 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:57.310397 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-17c8d344-1902-4a8d-8743-2fe6ff9890d0 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:57.310790 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-eb267fc9-954b-45a7-b191-52e2da9eb793 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:57.311199 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-eb267fc9-954b-45a7-b191-52e2da9eb793 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:57.311303 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-17c8d344-1902-4a8d-8743-2fe6ff9890d0 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:57.311647 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-17c8d344-1902-4a8d-8743-2fe6ff9890d0 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:57.534114 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-17c8d344-1902-4a8d-8743-2fe6ff9890d0 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14092cdf420c419caa3c79434dee6194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe481a378f5454d975d405bc78d1203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:57.537150 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-eb267fc9-954b-45a7-b191-52e2da9eb793 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:57.545211 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-17c8d344-1902-4a8d-8743-2fe6ff9890d0 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] 10.222.0.66 "GET /compute/v2.1/servers/c0b8e2b0-4292-43fa-8130-fa801fd2d223" status: 200 len: 1315 microversion: 2.1 time: 0.246326 Jun 22 10:21:57.546636 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 111/203] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:57 2022] GET /compute/v2.1/servers/c0b8e2b0-4292-43fa-8130-fa801fd2d223 => generated 1315 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:57.547657 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-eb267fc9-954b-45a7-b191-52e2da9eb793 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1521 microversion: 2.1 time: 0.251894 Jun 22 10:21:57.552750 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-4f56e5a3-56e5-492b-9b5d-bab380acdc4d tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:57.553694 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-4f56e5a3-56e5-492b-9b5d-bab380acdc4d tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 737e0985-7e40-4d2b-ad8e-81dbf965e1e3] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:57.560947 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 93/204] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:57 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1521 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:57.561629 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4f56e5a3-56e5-492b-9b5d-bab380acdc4d tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:57.562422 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4f56e5a3-56e5-492b-9b5d-bab380acdc4d tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:57.563465 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4f56e5a3-56e5-492b-9b5d-bab380acdc4d tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:57.564044 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4f56e5a3-56e5-492b-9b5d-bab380acdc4d tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:57.565823 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-e5f75f6b-a269-4b3f-b9eb-cf6fe1cc26c4 req-b3d597e2-21d7-4ea5-b030-c2297e17225d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0b8e2b0-4292-43fa-8130-fa801fd2d223", "name": "network-vif-plugged", "status": "completed", "tag": "503104fd-bfc6-4360-9f0e-8d9c5f6d3feb"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:21:57.574760 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-e5f75f6b-a269-4b3f-b9eb-cf6fe1cc26c4 req-b3d597e2-21d7-4ea5-b030-c2297e17225d service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:57.574995 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-e5f75f6b-a269-4b3f-b9eb-cf6fe1cc26c4 req-b3d597e2-21d7-4ea5-b030-c2297e17225d service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:57.589618 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-e5f75f6b-a269-4b3f-b9eb-cf6fe1cc26c4 req-b3d597e2-21d7-4ea5-b030-c2297e17225d service nova] Creating event network-vif-plugged:503104fd-bfc6-4360-9f0e-8d9c5f6d3feb for instance c0b8e2b0-4292-43fa-8130-fa801fd2d223 on hv-cinder-84713 Jun 22 10:21:57.607327 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-e5f75f6b-a269-4b3f-b9eb-cf6fe1cc26c4 req-b3d597e2-21d7-4ea5-b030-c2297e17225d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044876 Jun 22 10:21:57.621061 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 94/205] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:21:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:21:57.720292 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-4f56e5a3-56e5-492b-9b5d-bab380acdc4d tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5370eb5245247a68d7f224cdd457ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:57.729377 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-4f56e5a3-56e5-492b-9b5d-bab380acdc4d tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3" status: 200 len: 1210 microversion: 2.1 time: 0.181426 Jun 22 10:21:57.730211 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 112/206] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:57 2022] GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3 => generated 1210 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:58.563930 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-644ebe9d-217a-4923-a484-993d150594a1 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:58.564615 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-644ebe9d-217a-4923-a484-993d150594a1 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] [instance: c0b8e2b0-4292-43fa-8130-fa801fd2d223] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:58.564753 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-10343ffa-499f-46cb-8424-2db60fee25f0 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:58.565317 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-10343ffa-499f-46cb-8424-2db60fee25f0 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:58.567273 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:58.572393 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-10343ffa-499f-46cb-8424-2db60fee25f0 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:58.572851 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-10343ffa-499f-46cb-8424-2db60fee25f0 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:58.573235 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-644ebe9d-217a-4923-a484-993d150594a1 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:58.573627 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-10343ffa-499f-46cb-8424-2db60fee25f0 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:58.573734 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-644ebe9d-217a-4923-a484-993d150594a1 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:58.574200 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-10343ffa-499f-46cb-8424-2db60fee25f0 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:58.574513 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-644ebe9d-217a-4923-a484-993d150594a1 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:58.574954 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-644ebe9d-217a-4923-a484-993d150594a1 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:58.580723 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:SELECT=100 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:21:58.774469 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-10343ffa-499f-46cb-8424-2db60fee25f0 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:58.779159 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-644ebe9d-217a-4923-a484-993d150594a1 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14092cdf420c419caa3c79434dee6194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe481a378f5454d975d405bc78d1203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:58.782785 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-10343ffa-499f-46cb-8424-2db60fee25f0 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1521 microversion: 2.1 time: 0.222360 Jun 22 10:21:58.786685 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 113/207] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:58 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:21:58.788577 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-d40da165-0637-4a8a-ac7b-cc9a40206beb tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:58.789201 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-d40da165-0637-4a8a-ac7b-cc9a40206beb tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 737e0985-7e40-4d2b-ad8e-81dbf965e1e3] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:58.789938 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-644ebe9d-217a-4923-a484-993d150594a1 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] 10.222.0.66 "GET /compute/v2.1/servers/c0b8e2b0-4292-43fa-8130-fa801fd2d223" status: 200 len: 1315 microversion: 2.1 time: 0.230407 Jun 22 10:21:58.791193 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 95/208] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:58 2022] GET /compute/v2.1/servers/c0b8e2b0-4292-43fa-8130-fa801fd2d223 => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:58.804087 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d40da165-0637-4a8a-ac7b-cc9a40206beb tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:58.804720 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d40da165-0637-4a8a-ac7b-cc9a40206beb tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:58.805515 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d40da165-0637-4a8a-ac7b-cc9a40206beb tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:58.806025 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d40da165-0637-4a8a-ac7b-cc9a40206beb tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:58.827637 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-411fee34-5fed-47ee-9ee3-47997d29dd70 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:58.828207 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-411fee34-5fed-47ee-9ee3-47997d29dd70 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] [instance: 76efde76-215b-4c32-992f-3fe518470987] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:58.834926 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-411fee34-5fed-47ee-9ee3-47997d29dd70 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:58.835460 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-411fee34-5fed-47ee-9ee3-47997d29dd70 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:58.836295 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-411fee34-5fed-47ee-9ee3-47997d29dd70 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:58.836792 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-411fee34-5fed-47ee-9ee3-47997d29dd70 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:58.866762 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-411fee34-5fed-47ee-9ee3-47997d29dd70 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] [instance: 76efde76-215b-4c32-992f-3fe518470987] Going to try to terminate instance {{(pid=117679) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 10:21:58.870688 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-d40da165-0637-4a8a-ac7b-cc9a40206beb tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5370eb5245247a68d7f224cdd457ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:58.878364 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-d40da165-0637-4a8a-ac7b-cc9a40206beb tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3" status: 200 len: 1272 microversion: 2.1 time: 0.093557 Jun 22 10:21:58.878961 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 114/209] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:58 2022] GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3 => generated 1272 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:58.973271 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-411fee34-5fed-47ee-9ee3-47997d29dd70 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] 10.222.0.66 "DELETE /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987" status: 204 len: 0 microversion: 2.1 time: 0.149161 Jun 22 10:21:58.974982 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 96/210] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Jun 22 10:21:58 2022] DELETE /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 10:21:58.983395 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-2d398956-e6b5-4251-b1fd-8b84240a27da tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:58.984183 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-2d398956-e6b5-4251-b1fd-8b84240a27da tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] [instance: 76efde76-215b-4c32-992f-3fe518470987] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:58.990676 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2d398956-e6b5-4251-b1fd-8b84240a27da tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:58.991137 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2d398956-e6b5-4251-b1fd-8b84240a27da tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:58.991915 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2d398956-e6b5-4251-b1fd-8b84240a27da tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:58.992365 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2d398956-e6b5-4251-b1fd-8b84240a27da tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:59.194495 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-2d398956-e6b5-4251-b1fd-8b84240a27da tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d2a62272e248d3b11aca8737e22fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e253dfe684b469383c18ff8c2a3dbd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:21:59.203093 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-2d398956-e6b5-4251-b1fd-8b84240a27da tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] 10.222.0.66 "GET /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987" status: 200 len: 1554 microversion: 2.1 time: 0.223444 Jun 22 10:21:59.204208 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 115/211] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:58 2022] GET /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987 => generated 1554 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:21:59.804858 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-9d9395b8-a440-42d0-8de6-655008a880d5 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:59.806188 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-9d9395b8-a440-42d0-8de6-655008a880d5 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:59.808645 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-db5572ea-509e-4125-ab4f-9d7aa2491ee4 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:21:59.809808 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-db5572ea-509e-4125-ab4f-9d7aa2491ee4 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] [instance: c0b8e2b0-4292-43fa-8130-fa801fd2d223] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:21:59.813214 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9d9395b8-a440-42d0-8de6-655008a880d5 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:59.813670 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9d9395b8-a440-42d0-8de6-655008a880d5 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:59.815083 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9d9395b8-a440-42d0-8de6-655008a880d5 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:59.815648 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9d9395b8-a440-42d0-8de6-655008a880d5 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:59.815842 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-db5572ea-509e-4125-ab4f-9d7aa2491ee4 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:59.816323 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-db5572ea-509e-4125-ab4f-9d7aa2491ee4 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:59.817120 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-db5572ea-509e-4125-ab4f-9d7aa2491ee4 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:21:59.817559 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-db5572ea-509e-4125-ab4f-9d7aa2491ee4 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:21:59.818603 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:00.016154 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-db5572ea-509e-4125-ab4f-9d7aa2491ee4 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14092cdf420c419caa3c79434dee6194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe481a378f5454d975d405bc78d1203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:00.021250 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-9d9395b8-a440-42d0-8de6-655008a880d5 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:00.024477 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-db5572ea-509e-4125-ab4f-9d7aa2491ee4 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] 10.222.0.66 "GET /compute/v2.1/servers/c0b8e2b0-4292-43fa-8130-fa801fd2d223" status: 200 len: 1315 microversion: 2.1 time: 0.221126 Jun 22 10:22:00.025082 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 116/212] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:59 2022] GET /compute/v2.1/servers/c0b8e2b0-4292-43fa-8130-fa801fd2d223 => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:00.029634 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-1a317f4d-603e-4eca-952b-b52edc65655c tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:00.030184 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-9d9395b8-a440-42d0-8de6-655008a880d5 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1521 microversion: 2.1 time: 0.232059 Jun 22 10:22:00.030307 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-1a317f4d-603e-4eca-952b-b52edc65655c tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 737e0985-7e40-4d2b-ad8e-81dbf965e1e3] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:00.031311 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 97/213] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:21:59 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:00.037380 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1a317f4d-603e-4eca-952b-b52edc65655c tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:00.037837 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1a317f4d-603e-4eca-952b-b52edc65655c tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:00.038681 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1a317f4d-603e-4eca-952b-b52edc65655c tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:00.039121 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1a317f4d-603e-4eca-952b-b52edc65655c tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:00.181089 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-1a317f4d-603e-4eca-952b-b52edc65655c tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5370eb5245247a68d7f224cdd457ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:00.189014 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-1a317f4d-603e-4eca-952b-b52edc65655c tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3" status: 200 len: 1314 microversion: 2.1 time: 0.162915 Jun 22 10:22:00.189596 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 117/214] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:00 2022] GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:00.220928 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-cb76b071-5cdf-4bc0-afb7-65148b07d8a0 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:00.221552 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-cb76b071-5cdf-4bc0-afb7-65148b07d8a0 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] [instance: 76efde76-215b-4c32-992f-3fe518470987] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:00.228260 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-cb76b071-5cdf-4bc0-afb7-65148b07d8a0 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:00.228739 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-cb76b071-5cdf-4bc0-afb7-65148b07d8a0 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:00.229577 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-cb76b071-5cdf-4bc0-afb7-65148b07d8a0 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:00.230009 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-cb76b071-5cdf-4bc0-afb7-65148b07d8a0 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:00.366939 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-cb76b071-5cdf-4bc0-afb7-65148b07d8a0 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d2a62272e248d3b11aca8737e22fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e253dfe684b469383c18ff8c2a3dbd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:00.375434 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-cb76b071-5cdf-4bc0-afb7-65148b07d8a0 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] 10.222.0.66 "GET /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987" status: 200 len: 1554 microversion: 2.1 time: 0.158299 Jun 22 10:22:00.375921 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 98/215] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:00 2022] GET /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987 => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:01.042399 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-9020ddbd-f5ff-46c4-a8f0-21c698bad38a tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:01.043212 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-9020ddbd-f5ff-46c4-a8f0-21c698bad38a tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] [instance: c0b8e2b0-4292-43fa-8130-fa801fd2d223] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:01.048798 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-20580639-e62a-4ee6-bc30-d21a8b360598 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:01.049881 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-20580639-e62a-4ee6-bc30-d21a8b360598 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:01.050363 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9020ddbd-f5ff-46c4-a8f0-21c698bad38a tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:01.050936 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9020ddbd-f5ff-46c4-a8f0-21c698bad38a tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:01.051832 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9020ddbd-f5ff-46c4-a8f0-21c698bad38a tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:01.052355 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9020ddbd-f5ff-46c4-a8f0-21c698bad38a tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:01.062945 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-20580639-e62a-4ee6-bc30-d21a8b360598 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:01.063747 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-20580639-e62a-4ee6-bc30-d21a8b360598 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:01.065163 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-20580639-e62a-4ee6-bc30-d21a8b360598 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:01.066229 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-20580639-e62a-4ee6-bc30-d21a8b360598 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:01.250311 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-9020ddbd-f5ff-46c4-a8f0-21c698bad38a tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14092cdf420c419caa3c79434dee6194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe481a378f5454d975d405bc78d1203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:01.257951 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-9020ddbd-f5ff-46c4-a8f0-21c698bad38a tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] 10.222.0.66 "GET /compute/v2.1/servers/c0b8e2b0-4292-43fa-8130-fa801fd2d223" status: 200 len: 1315 microversion: 2.1 time: 0.219803 Jun 22 10:22:01.258680 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 118/216] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:01 2022] GET /compute/v2.1/servers/c0b8e2b0-4292-43fa-8130-fa801fd2d223 => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:01.263470 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-93d3751e-a005-472d-8fa9-32dcee7b5588 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:01.264275 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-93d3751e-a005-472d-8fa9-32dcee7b5588 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 737e0985-7e40-4d2b-ad8e-81dbf965e1e3] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:01.270474 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-93d3751e-a005-472d-8fa9-32dcee7b5588 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:01.270960 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-93d3751e-a005-472d-8fa9-32dcee7b5588 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:01.271722 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-93d3751e-a005-472d-8fa9-32dcee7b5588 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:01.272169 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-93d3751e-a005-472d-8fa9-32dcee7b5588 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:01.272320 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-20580639-e62a-4ee6-bc30-d21a8b360598 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:01.280205 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-20580639-e62a-4ee6-bc30-d21a8b360598 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1521 microversion: 2.1 time: 0.235951 Jun 22 10:22:01.281183 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 99/217] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:01 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:01.395742 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-f985c3d2-2000-4f0e-a33a-1ee9722bdd9f tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:01.396571 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-f985c3d2-2000-4f0e-a33a-1ee9722bdd9f tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] [instance: 76efde76-215b-4c32-992f-3fe518470987] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:01.402999 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f985c3d2-2000-4f0e-a33a-1ee9722bdd9f tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:01.403432 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f985c3d2-2000-4f0e-a33a-1ee9722bdd9f tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:01.404204 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f985c3d2-2000-4f0e-a33a-1ee9722bdd9f tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:01.404632 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f985c3d2-2000-4f0e-a33a-1ee9722bdd9f tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:01.414098 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-93d3751e-a005-472d-8fa9-32dcee7b5588 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5370eb5245247a68d7f224cdd457ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:01.421750 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-93d3751e-a005-472d-8fa9-32dcee7b5588 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3" status: 200 len: 1314 microversion: 2.1 time: 0.162016 Jun 22 10:22:01.422326 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 119/218] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:01 2022] GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:01.532682 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-f985c3d2-2000-4f0e-a33a-1ee9722bdd9f tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d2a62272e248d3b11aca8737e22fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e253dfe684b469383c18ff8c2a3dbd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:01.540708 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-f985c3d2-2000-4f0e-a33a-1ee9722bdd9f tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] 10.222.0.66 "GET /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987" status: 200 len: 1554 microversion: 2.1 time: 0.151191 Jun 22 10:22:01.541300 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 100/219] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:01 2022] GET /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987 => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:02.275273 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-f85eba35-55d8-47f3-a387-b368c7d93877 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:02.275912 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-f85eba35-55d8-47f3-a387-b368c7d93877 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] [instance: c0b8e2b0-4292-43fa-8130-fa801fd2d223] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:02.277834 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell0:SELECT=2 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:02.279661 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:02.284459 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f85eba35-55d8-47f3-a387-b368c7d93877 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:02.284987 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f85eba35-55d8-47f3-a387-b368c7d93877 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:02.285681 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f85eba35-55d8-47f3-a387-b368c7d93877 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:02.286108 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f85eba35-55d8-47f3-a387-b368c7d93877 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:02.294314 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_cell0:SELECT=2 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:02.295658 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_cell0:SELECT=6 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:02.300932 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-69754cc5-3890-471e-a614-ddff08e6e355 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:02.301481 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-69754cc5-3890-471e-a614-ddff08e6e355 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:02.308849 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-69754cc5-3890-471e-a614-ddff08e6e355 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:02.309294 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-69754cc5-3890-471e-a614-ddff08e6e355 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:02.310242 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-69754cc5-3890-471e-a614-ddff08e6e355 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:02.310686 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-69754cc5-3890-471e-a614-ddff08e6e355 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:02.555132 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-f85eba35-55d8-47f3-a387-b368c7d93877 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14092cdf420c419caa3c79434dee6194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe481a378f5454d975d405bc78d1203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:02.563328 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-f85eba35-55d8-47f3-a387-b368c7d93877 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] 10.222.0.66 "GET /compute/v2.1/servers/c0b8e2b0-4292-43fa-8130-fa801fd2d223" status: 200 len: 1315 microversion: 2.1 time: 0.291892 Jun 22 10:22:02.564399 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 120/220] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:02 2022] GET /compute/v2.1/servers/c0b8e2b0-4292-43fa-8130-fa801fd2d223 => generated 1315 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:02.569087 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-05dbf969-ed75-4101-b277-dd5789a8895d tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:02.569698 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-05dbf969-ed75-4101-b277-dd5789a8895d tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 737e0985-7e40-4d2b-ad8e-81dbf965e1e3] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:02.576299 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-05dbf969-ed75-4101-b277-dd5789a8895d tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:02.576753 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-05dbf969-ed75-4101-b277-dd5789a8895d tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:02.577759 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-05dbf969-ed75-4101-b277-dd5789a8895d tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:02.578212 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-05dbf969-ed75-4101-b277-dd5789a8895d tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:02.590147 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-69754cc5-3890-471e-a614-ddff08e6e355 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:02.599196 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-69754cc5-3890-471e-a614-ddff08e6e355 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1521 microversion: 2.1 time: 0.305539 Jun 22 10:22:02.599791 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 101/221] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:02 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1521 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:02.604824 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-02db7a74-1914-4838-9010-f4edc190150e tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:02.605641 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-02db7a74-1914-4838-9010-f4edc190150e tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] [instance: 76efde76-215b-4c32-992f-3fe518470987] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:02.613826 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-02db7a74-1914-4838-9010-f4edc190150e tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:02.614440 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-02db7a74-1914-4838-9010-f4edc190150e tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:02.615274 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-02db7a74-1914-4838-9010-f4edc190150e tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:02.615722 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-02db7a74-1914-4838-9010-f4edc190150e tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:03.050034 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-05dbf969-ed75-4101-b277-dd5789a8895d tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5370eb5245247a68d7f224cdd457ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:03.057947 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-05dbf969-ed75-4101-b277-dd5789a8895d tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3" status: 200 len: 1314 microversion: 2.1 time: 0.492399 Jun 22 10:22:03.058531 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 121/222] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:02 2022] GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3 => generated 1314 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:03.078758 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-02db7a74-1914-4838-9010-f4edc190150e tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d2a62272e248d3b11aca8737e22fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e253dfe684b469383c18ff8c2a3dbd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:03.087217 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-02db7a74-1914-4838-9010-f4edc190150e tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] 10.222.0.66 "GET /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987" status: 200 len: 1554 microversion: 2.1 time: 0.486246 Jun 22 10:22:03.092950 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 102/223] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:02 2022] GET /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987 => generated 1554 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:03.169603 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-4ef7bdcb-bcbf-4959-bd1d-0f764533043b req-418ccbcd-5bec-47ec-af89-e09948933c37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "737e0985-7e40-4d2b-ad8e-81dbf965e1e3", "tag": "8aab1b56-8fc8-4c1b-9126-4d9686689409"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:22:03.178823 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-4ef7bdcb-bcbf-4959-bd1d-0f764533043b req-418ccbcd-5bec-47ec-af89-e09948933c37 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:03.179670 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-4ef7bdcb-bcbf-4959-bd1d-0f764533043b req-418ccbcd-5bec-47ec-af89-e09948933c37 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:03.192187 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-4ef7bdcb-bcbf-4959-bd1d-0f764533043b req-418ccbcd-5bec-47ec-af89-e09948933c37 service nova] Creating event network-changed:8aab1b56-8fc8-4c1b-9126-4d9686689409 for instance 737e0985-7e40-4d2b-ad8e-81dbf965e1e3 on hv-cinder-84713 Jun 22 10:22:03.197492 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-4ef7bdcb-bcbf-4959-bd1d-0f764533043b req-418ccbcd-5bec-47ec-af89-e09948933c37 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033519 Jun 22 10:22:03.198184 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 122/224] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:22:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:22:03.379102 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-27a8d3c3-0cac-460b-9c92-3b8b61d9ad5e req-1b274877-78fc-432e-8720-b78fa9afb1e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76efde76-215b-4c32-992f-3fe518470987", "name": "network-vif-deleted", "tag": "2090a85a-6974-46b1-961e-31005ede8287"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:22:03.388922 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-27a8d3c3-0cac-460b-9c92-3b8b61d9ad5e req-1b274877-78fc-432e-8720-b78fa9afb1e9 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:03.389356 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-27a8d3c3-0cac-460b-9c92-3b8b61d9ad5e req-1b274877-78fc-432e-8720-b78fa9afb1e9 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:03.401383 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-27a8d3c3-0cac-460b-9c92-3b8b61d9ad5e req-1b274877-78fc-432e-8720-b78fa9afb1e9 service nova] Creating event network-vif-deleted:2090a85a-6974-46b1-961e-31005ede8287 for instance 76efde76-215b-4c32-992f-3fe518470987 on hv-cinder-84713 Jun 22 10:22:03.406768 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-27a8d3c3-0cac-460b-9c92-3b8b61d9ad5e req-1b274877-78fc-432e-8720-b78fa9afb1e9 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031476 Jun 22 10:22:03.407646 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 103/225] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:22:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:22:03.581755 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-a63a40aa-4888-4ed0-a64c-7ff4e3a794ce tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:03.582306 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-a63a40aa-4888-4ed0-a64c-7ff4e3a794ce tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] [instance: c0b8e2b0-4292-43fa-8130-fa801fd2d223] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:03.589458 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a63a40aa-4888-4ed0-a64c-7ff4e3a794ce tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:03.589921 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a63a40aa-4888-4ed0-a64c-7ff4e3a794ce tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:03.590730 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a63a40aa-4888-4ed0-a64c-7ff4e3a794ce tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:03.591143 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a63a40aa-4888-4ed0-a64c-7ff4e3a794ce tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:03.616798 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-e2de2737-49bc-495a-a3af-37f5aac382e7 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:03.617888 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-e2de2737-49bc-495a-a3af-37f5aac382e7 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:03.625375 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e2de2737-49bc-495a-a3af-37f5aac382e7 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:03.625799 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e2de2737-49bc-495a-a3af-37f5aac382e7 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:03.626689 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e2de2737-49bc-495a-a3af-37f5aac382e7 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:03.627130 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e2de2737-49bc-495a-a3af-37f5aac382e7 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:03.812131 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-a63a40aa-4888-4ed0-a64c-7ff4e3a794ce tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14092cdf420c419caa3c79434dee6194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe481a378f5454d975d405bc78d1203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:03.815842 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-e2de2737-49bc-495a-a3af-37f5aac382e7 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:03.824953 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-e2de2737-49bc-495a-a3af-37f5aac382e7 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1521 microversion: 2.1 time: 0.212375 Jun 22 10:22:03.827302 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-a63a40aa-4888-4ed0-a64c-7ff4e3a794ce tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] 10.222.0.66 "GET /compute/v2.1/servers/c0b8e2b0-4292-43fa-8130-fa801fd2d223" status: 200 len: 1465 microversion: 2.1 time: 0.249928 Jun 22 10:22:03.828128 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 123/226] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:03 2022] GET /compute/v2.1/servers/c0b8e2b0-4292-43fa-8130-fa801fd2d223 => generated 1465 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:03.835079 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 104/227] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:03 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:03.878319 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-44f31963-68bc-482a-9593-690c9267ce4b tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:03.878882 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-44f31963-68bc-482a-9593-690c9267ce4b tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] [instance: c0b8e2b0-4292-43fa-8130-fa801fd2d223] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:03.885555 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-44f31963-68bc-482a-9593-690c9267ce4b tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:03.886174 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-44f31963-68bc-482a-9593-690c9267ce4b tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:03.887017 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-44f31963-68bc-482a-9593-690c9267ce4b tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:03.887448 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-44f31963-68bc-482a-9593-690c9267ce4b tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:03.915610 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-44f31963-68bc-482a-9593-690c9267ce4b tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] [instance: c0b8e2b0-4292-43fa-8130-fa801fd2d223] Going to try to terminate instance {{(pid=117680) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 10:22:04.022541 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-44f31963-68bc-482a-9593-690c9267ce4b tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] 10.222.0.66 "DELETE /compute/v2.1/servers/c0b8e2b0-4292-43fa-8130-fa801fd2d223" status: 204 len: 0 microversion: 2.1 time: 0.147923 Jun 22 10:22:04.023267 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 124/228] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Jun 22 10:22:03 2022] DELETE /compute/v2.1/servers/c0b8e2b0-4292-43fa-8130-fa801fd2d223 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 10:22:04.032078 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-311fc5a2-01b3-4920-a0e8-12ff27bcd800 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:04.032862 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-311fc5a2-01b3-4920-a0e8-12ff27bcd800 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] [instance: c0b8e2b0-4292-43fa-8130-fa801fd2d223] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:04.039085 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-311fc5a2-01b3-4920-a0e8-12ff27bcd800 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:04.039524 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-311fc5a2-01b3-4920-a0e8-12ff27bcd800 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:04.040294 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-311fc5a2-01b3-4920-a0e8-12ff27bcd800 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:04.040746 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-311fc5a2-01b3-4920-a0e8-12ff27bcd800 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:04.075606 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-f87cdddf-3f12-433e-891e-6989bacf966e tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:04.077052 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-f87cdddf-3f12-433e-891e-6989bacf966e tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 737e0985-7e40-4d2b-ad8e-81dbf965e1e3] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:04.084003 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f87cdddf-3f12-433e-891e-6989bacf966e tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:04.084543 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f87cdddf-3f12-433e-891e-6989bacf966e tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:04.085469 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f87cdddf-3f12-433e-891e-6989bacf966e tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:04.085915 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f87cdddf-3f12-433e-891e-6989bacf966e tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:04.228593 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-311fc5a2-01b3-4920-a0e8-12ff27bcd800 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14092cdf420c419caa3c79434dee6194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe481a378f5454d975d405bc78d1203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:04.236564 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-311fc5a2-01b3-4920-a0e8-12ff27bcd800 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] 10.222.0.66 "GET /compute/v2.1/servers/c0b8e2b0-4292-43fa-8130-fa801fd2d223" status: 200 len: 1471 microversion: 2.1 time: 0.208769 Jun 22 10:22:04.237413 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 105/229] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:04 2022] GET /compute/v2.1/servers/c0b8e2b0-4292-43fa-8130-fa801fd2d223 => generated 1471 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:04.242097 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-26562ff7-2cf8-4b1b-aa40-c34f2ea3fb41 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:04.242778 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-26562ff7-2cf8-4b1b-aa40-c34f2ea3fb41 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] [instance: 76efde76-215b-4c32-992f-3fe518470987] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:04.249204 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-26562ff7-2cf8-4b1b-aa40-c34f2ea3fb41 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:04.249648 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-26562ff7-2cf8-4b1b-aa40-c34f2ea3fb41 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:04.250413 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-26562ff7-2cf8-4b1b-aa40-c34f2ea3fb41 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:04.250894 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-26562ff7-2cf8-4b1b-aa40-c34f2ea3fb41 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:04.267974 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-f87cdddf-3f12-433e-891e-6989bacf966e tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5370eb5245247a68d7f224cdd457ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:04.276806 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-f87cdddf-3f12-433e-891e-6989bacf966e tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3" status: 200 len: 1314 microversion: 2.1 time: 0.205469 Jun 22 10:22:04.277508 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 125/230] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:04 2022] GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:04.288720 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-26562ff7-2cf8-4b1b-aa40-c34f2ea3fb41 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:04.289496 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-26562ff7-2cf8-4b1b-aa40-c34f2ea3fb41 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:04.290255 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.objects.instance [None req-26562ff7-2cf8-4b1b-aa40-c34f2ea3fb41 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lazy-loading 'fault' on Instance uuid 76efde76-215b-4c32-992f-3fe518470987 {{(pid=117679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:22:04.344912 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-26562ff7-2cf8-4b1b-aa40-c34f2ea3fb41 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d2a62272e248d3b11aca8737e22fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e253dfe684b469383c18ff8c2a3dbd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:04.353276 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-26562ff7-2cf8-4b1b-aa40-c34f2ea3fb41 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] 10.222.0.66 "GET /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987" status: 200 len: 1351 microversion: 2.1 time: 0.115043 Jun 22 10:22:04.353855 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 106/231] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:04 2022] GET /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987 => generated 1351 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:04.842486 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-95b95f00-7dd6-416d-b79c-7e83de4eb1cf tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:04.843232 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-95b95f00-7dd6-416d-b79c-7e83de4eb1cf tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:04.849639 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-95b95f00-7dd6-416d-b79c-7e83de4eb1cf tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:04.850082 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-95b95f00-7dd6-416d-b79c-7e83de4eb1cf tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:04.850881 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-95b95f00-7dd6-416d-b79c-7e83de4eb1cf tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:04.851310 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-95b95f00-7dd6-416d-b79c-7e83de4eb1cf tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:04.987161 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-95b95f00-7dd6-416d-b79c-7e83de4eb1cf tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:04.995199 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-95b95f00-7dd6-416d-b79c-7e83de4eb1cf tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1521 microversion: 2.1 time: 0.156671 Jun 22 10:22:04.995771 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 126/232] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:04 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:05.259801 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-884bc817-195a-4509-87d7-51e40c51901a tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:05.260331 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-884bc817-195a-4509-87d7-51e40c51901a tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] [instance: c0b8e2b0-4292-43fa-8130-fa801fd2d223] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:05.267456 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-884bc817-195a-4509-87d7-51e40c51901a tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:05.267905 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-884bc817-195a-4509-87d7-51e40c51901a tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:05.268688 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-884bc817-195a-4509-87d7-51e40c51901a tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:05.269115 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-884bc817-195a-4509-87d7-51e40c51901a tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:05.294805 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-5f8d24fc-b90d-4368-a9c6-2be1c33faa36 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:05.295408 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-5f8d24fc-b90d-4368-a9c6-2be1c33faa36 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 737e0985-7e40-4d2b-ad8e-81dbf965e1e3] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:05.302356 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5f8d24fc-b90d-4368-a9c6-2be1c33faa36 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:05.302796 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5f8d24fc-b90d-4368-a9c6-2be1c33faa36 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:05.303573 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5f8d24fc-b90d-4368-a9c6-2be1c33faa36 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:05.304001 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5f8d24fc-b90d-4368-a9c6-2be1c33faa36 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:05.452826 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-884bc817-195a-4509-87d7-51e40c51901a tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14092cdf420c419caa3c79434dee6194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe481a378f5454d975d405bc78d1203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:05.465518 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-884bc817-195a-4509-87d7-51e40c51901a tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] 10.222.0.66 "GET /compute/v2.1/servers/c0b8e2b0-4292-43fa-8130-fa801fd2d223" status: 200 len: 1471 microversion: 2.1 time: 0.210336 Jun 22 10:22:05.468037 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 107/233] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:05 2022] GET /compute/v2.1/servers/c0b8e2b0-4292-43fa-8130-fa801fd2d223 => generated 1471 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:05.473258 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-caca1bae-d77f-4480-97d5-cc1b3ef11275 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:05.473865 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-caca1bae-d77f-4480-97d5-cc1b3ef11275 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] [instance: 76efde76-215b-4c32-992f-3fe518470987] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:05.483819 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-caca1bae-d77f-4480-97d5-cc1b3ef11275 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:05.484262 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-caca1bae-d77f-4480-97d5-cc1b3ef11275 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:05.485066 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-caca1bae-d77f-4480-97d5-cc1b3ef11275 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:05.485438 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-caca1bae-d77f-4480-97d5-cc1b3ef11275 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:05.487668 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-5f8d24fc-b90d-4368-a9c6-2be1c33faa36 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5370eb5245247a68d7f224cdd457ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:05.495486 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-5f8d24fc-b90d-4368-a9c6-2be1c33faa36 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3" status: 200 len: 1314 microversion: 2.1 time: 0.204701 Jun 22 10:22:05.500824 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 127/234] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:05 2022] GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:05.518270 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-caca1bae-d77f-4480-97d5-cc1b3ef11275 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:05.518668 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-caca1bae-d77f-4480-97d5-cc1b3ef11275 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:05.519110 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.objects.instance [None req-caca1bae-d77f-4480-97d5-cc1b3ef11275 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lazy-loading 'fault' on Instance uuid 76efde76-215b-4c32-992f-3fe518470987 {{(pid=117679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:22:05.559368 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-caca1bae-d77f-4480-97d5-cc1b3ef11275 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96d2a62272e248d3b11aca8737e22fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e253dfe684b469383c18ff8c2a3dbd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:05.567722 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-caca1bae-d77f-4480-97d5-cc1b3ef11275 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] 10.222.0.66 "GET /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987" status: 200 len: 1351 microversion: 2.1 time: 0.098560 Jun 22 10:22:05.568271 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 108/235] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:05 2022] GET /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987 => generated 1351 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:06.013366 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-a4b1587f-eb50-4fef-8f9c-acc6eec4d518 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:06.013964 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-a4b1587f-eb50-4fef-8f9c-acc6eec4d518 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:06.020591 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a4b1587f-eb50-4fef-8f9c-acc6eec4d518 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:06.021047 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a4b1587f-eb50-4fef-8f9c-acc6eec4d518 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:06.021833 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a4b1587f-eb50-4fef-8f9c-acc6eec4d518 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:06.022268 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a4b1587f-eb50-4fef-8f9c-acc6eec4d518 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:06.153917 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-a4b1587f-eb50-4fef-8f9c-acc6eec4d518 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:06.157901 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:06.163625 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-a4b1587f-eb50-4fef-8f9c-acc6eec4d518 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1521 microversion: 2.1 time: 0.155052 Jun 22 10:22:06.164466 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 128/236] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:06 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:06.485360 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-0706aa20-2c87-4473-b431-4992cd30ea42 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:06.486183 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-0706aa20-2c87-4473-b431-4992cd30ea42 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] [instance: c0b8e2b0-4292-43fa-8130-fa801fd2d223] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:06.493320 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0706aa20-2c87-4473-b431-4992cd30ea42 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:06.493793 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0706aa20-2c87-4473-b431-4992cd30ea42 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:06.494662 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0706aa20-2c87-4473-b431-4992cd30ea42 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:06.495099 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0706aa20-2c87-4473-b431-4992cd30ea42 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:06.514252 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-460a958d-d404-4eb5-9d1b-fc41268310c7 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:06.514899 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-460a958d-d404-4eb5-9d1b-fc41268310c7 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 737e0985-7e40-4d2b-ad8e-81dbf965e1e3] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:06.523555 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-460a958d-d404-4eb5-9d1b-fc41268310c7 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:06.524082 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-460a958d-d404-4eb5-9d1b-fc41268310c7 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:06.524852 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-460a958d-d404-4eb5-9d1b-fc41268310c7 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:06.525348 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-460a958d-d404-4eb5-9d1b-fc41268310c7 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:06.816565 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-460a958d-d404-4eb5-9d1b-fc41268310c7 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5370eb5245247a68d7f224cdd457ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:06.825326 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-460a958d-d404-4eb5-9d1b-fc41268310c7 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3" status: 200 len: 1314 microversion: 2.1 time: 0.315752 Jun 22 10:22:06.828961 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 129/237] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:06 2022] GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3 => generated 1314 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:06.831292 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-dec7f58c-a185-409b-a0af-32b9eac84962 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:06.831948 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-dec7f58c-a185-409b-a0af-32b9eac84962 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] [instance: 76efde76-215b-4c32-992f-3fe518470987] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:06.838981 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-dec7f58c-a185-409b-a0af-32b9eac84962 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:06.839601 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-dec7f58c-a185-409b-a0af-32b9eac84962 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:06.840389 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-dec7f58c-a185-409b-a0af-32b9eac84962 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:06.841417 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-dec7f58c-a185-409b-a0af-32b9eac84962 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:06.857352 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.wsgi [None req-dec7f58c-a185-409b-a0af-32b9eac84962 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] HTTP exception thrown: Instance 76efde76-215b-4c32-992f-3fe518470987 could not be found. Jun 22 10:22:06.861962 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-dec7f58c-a185-409b-a0af-32b9eac84962 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Request method failure captured: Jun 22 10:22:06.861962 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: request: GET /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987 HTTP/1.1 Jun 22 10:22:06.861962 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Accept: application/json Jun 22 10:22:06.861962 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Accept-Encoding: identity Jun 22 10:22:06.861962 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Connection: close Jun 22 10:22:06.861962 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Content-Length: 0 Jun 22 10:22:06.861962 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Content-Type: application/json Jun 22 10:22:06.861962 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Host: 10.222.0.66 Jun 22 10:22:06.861962 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Openstack-System-Scope: None Jun 22 10:22:06.861962 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: User-Agent: python-urllib3/1.26.9 Jun 22 10:22:06.861962 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Auth-Token: gAAAAABisuz3jCzjNp2uB5daoLu33D_JnqhPYKeBFZuO3ASVj1_GI2kZZdluJPloddxKYOWSs0-X-U3vyyEZx4cf6hIAwvVxCHvxeQ_m3HqfsiSo78sTYdxLckIZdYja6rhugjsd7TSsIpDhCV_p0nUhxfIfO1tYos2MQvEwGbu3fuK6AUlmyE0 Jun 22 10:22:06.861962 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Domain-Id: None Jun 22 10:22:06.861962 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Domain-Name: None Jun 22 10:22:06.861962 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Identity-Status: Confirmed Jun 22 10:22:06.861962 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Is-Admin-Project: True Jun 22 10:22:06.861962 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Domain-Id: default Jun 22 10:22:06.861962 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Domain-Name: Default Jun 22 10:22:06.861962 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Id: 3e253dfe684b469383c18ff8c2a3dbd9 Jun 22 10:22:06.861962 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Name: tempest-DeleteServersTestJSON-805240055 Jun 22 10:22:06.861962 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Role: member,reader Jun 22 10:22:06.861962 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Roles: member,reader Jun 22 10:22:06.863502 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_3e253dfe684b469383c18ff8c2a3dbd9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3e253dfe684b469383c18ff8c2a3dbd9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/3e253dfe684b469383c18ff8c2a3dbd9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3e253dfe684b469383c18ff8c2a3dbd9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}] Jun 22 10:22:06.863502 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant: tempest-DeleteServersTestJSON-805240055 Jun 22 10:22:06.863502 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant-Id: 3e253dfe684b469383c18ff8c2a3dbd9 Jun 22 10:22:06.863502 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant-Name: tempest-DeleteServersTestJSON-805240055 Jun 22 10:22:06.863502 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User: tempest-DeleteServersTestJSON-805240055-project Jun 22 10:22:06.863502 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Domain-Id: default Jun 22 10:22:06.863502 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Domain-Name: Default Jun 22 10:22:06.863502 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Id: 96d2a62272e248d3b11aca8737e22fb2 Jun 22 10:22:06.863502 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Name: tempest-DeleteServersTestJSON-805240055-project Jun 22 10:22:06.863502 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: method: > Jun 22 10:22:06.863502 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: exception: Instance 76efde76-215b-4c32-992f-3fe518470987 could not be found. Jun 22 10:22:06.863502 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: action_args: {'id': '76efde76-215b-4c32-992f-3fe518470987'} Jun 22 10:22:06.864184 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:22:06.864184 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:06.864184 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:22:06.864184 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:22:06.864184 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:22:06.864184 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:22:06.864184 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:22:06.864184 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:22:06.864184 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:22:06.864184 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:22:06.864184 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76efde76-215b-4c32-992f-3fe518470987 could not be found. Jun 22 10:22:06.864184 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:22:06.864184 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:22:06.864184 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:22:06.864184 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:06.864184 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:22:06.864184 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:22:06.864184 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:22:06.864184 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:22:06.864184 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:22:06.865338 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:22:06.865338 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:22:06.865338 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:22:06.865338 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:22:06.865338 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:22:06.865338 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:22:06.865338 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:22:06.865338 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76efde76-215b-4c32-992f-3fe518470987 could not be found. Jun 22 10:22:06.865338 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:22:06.865338 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:22:06.865338 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:22:06.865338 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:06.865338 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:22:06.865338 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:22:06.865338 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:22:06.865338 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:22:06.865338 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76efde76-215b-4c32-992f-3fe518470987 could not be found. Jun 22 10:22:06.865338 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:22:06.866375 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-dec7f58c-a185-409b-a0af-32b9eac84962 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Returning 404 to user: Instance 76efde76-215b-4c32-992f-3fe518470987 could not be found. {{(pid=117680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:22:06.866375 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-dec7f58c-a185-409b-a0af-32b9eac84962 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] 10.222.0.66 "GET /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987" status: 404 len: 111 microversion: 2.1 time: 0.036243 Jun 22 10:22:06.866375 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 130/238] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:06 2022] GET /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:22:06.887661 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-0706aa20-2c87-4473-b431-4992cd30ea42 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14092cdf420c419caa3c79434dee6194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe481a378f5454d975d405bc78d1203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:06.896277 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-0706aa20-2c87-4473-b431-4992cd30ea42 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] 10.222.0.66 "GET /compute/v2.1/servers/c0b8e2b0-4292-43fa-8130-fa801fd2d223" status: 200 len: 1471 microversion: 2.1 time: 0.415494 Jun 22 10:22:06.897079 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 109/239] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:06 2022] GET /compute/v2.1/servers/c0b8e2b0-4292-43fa-8130-fa801fd2d223 => generated 1471 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:06.996966 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-f0ce2e75-2cb9-4686-9708-a8a35b033c89 req-4c43b34d-6392-4ec1-b8ab-c7d38573ed4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0b8e2b0-4292-43fa-8130-fa801fd2d223", "name": "network-vif-deleted", "tag": "503104fd-bfc6-4360-9f0e-8d9c5f6d3feb"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:22:06.997791 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-3d249cb0-285b-4806-94cc-0758c731cbe5 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:06.998856 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-3d249cb0-285b-4806-94cc-0758c731cbe5 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] [instance: 76efde76-215b-4c32-992f-3fe518470987] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:07.005848 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3d249cb0-285b-4806-94cc-0758c731cbe5 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:07.006300 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-f0ce2e75-2cb9-4686-9708-a8a35b033c89 req-4c43b34d-6392-4ec1-b8ab-c7d38573ed4a service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:07.006457 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3d249cb0-285b-4806-94cc-0758c731cbe5 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:07.006809 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-f0ce2e75-2cb9-4686-9708-a8a35b033c89 req-4c43b34d-6392-4ec1-b8ab-c7d38573ed4a service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:07.007091 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3d249cb0-285b-4806-94cc-0758c731cbe5 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:07.007714 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3d249cb0-285b-4806-94cc-0758c731cbe5 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:07.021273 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-f0ce2e75-2cb9-4686-9708-a8a35b033c89 req-4c43b34d-6392-4ec1-b8ab-c7d38573ed4a service nova] Creating event network-vif-deleted:503104fd-bfc6-4360-9f0e-8d9c5f6d3feb for instance c0b8e2b0-4292-43fa-8130-fa801fd2d223 on hv-cinder-84713 Jun 22 10:22:07.025749 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.wsgi [None req-3d249cb0-285b-4806-94cc-0758c731cbe5 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] HTTP exception thrown: Instance 76efde76-215b-4c32-992f-3fe518470987 could not be found. Jun 22 10:22:07.026926 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-f0ce2e75-2cb9-4686-9708-a8a35b033c89 req-4c43b34d-6392-4ec1-b8ab-c7d38573ed4a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034530 Jun 22 10:22:07.027553 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 131/240] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:22:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:22:07.031270 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-3d249cb0-285b-4806-94cc-0758c731cbe5 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Request method failure captured: Jun 22 10:22:07.031270 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: request: GET /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987/os-volume_attachments HTTP/1.1 Jun 22 10:22:07.031270 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Accept: application/json Jun 22 10:22:07.031270 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Accept-Encoding: identity Jun 22 10:22:07.031270 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Connection: close Jun 22 10:22:07.031270 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Content-Length: 0 Jun 22 10:22:07.031270 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Content-Type: application/json Jun 22 10:22:07.031270 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Host: 10.222.0.66 Jun 22 10:22:07.031270 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Openstack-System-Scope: None Jun 22 10:22:07.031270 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: User-Agent: python-urllib3/1.26.9 Jun 22 10:22:07.031270 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Auth-Token: gAAAAABisuz3jCzjNp2uB5daoLu33D_JnqhPYKeBFZuO3ASVj1_GI2kZZdluJPloddxKYOWSs0-X-U3vyyEZx4cf6hIAwvVxCHvxeQ_m3HqfsiSo78sTYdxLckIZdYja6rhugjsd7TSsIpDhCV_p0nUhxfIfO1tYos2MQvEwGbu3fuK6AUlmyE0 Jun 22 10:22:07.031270 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Domain-Id: None Jun 22 10:22:07.031270 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Domain-Name: None Jun 22 10:22:07.031270 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Identity-Status: Confirmed Jun 22 10:22:07.031270 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Is-Admin-Project: True Jun 22 10:22:07.031270 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Domain-Id: default Jun 22 10:22:07.031270 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Domain-Name: Default Jun 22 10:22:07.031270 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Id: 3e253dfe684b469383c18ff8c2a3dbd9 Jun 22 10:22:07.031270 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Name: tempest-DeleteServersTestJSON-805240055 Jun 22 10:22:07.031270 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Role: member,reader Jun 22 10:22:07.031270 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Roles: member,reader Jun 22 10:22:07.032507 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_3e253dfe684b469383c18ff8c2a3dbd9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3e253dfe684b469383c18ff8c2a3dbd9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/3e253dfe684b469383c18ff8c2a3dbd9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3e253dfe684b469383c18ff8c2a3dbd9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}] Jun 22 10:22:07.032507 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Tenant: tempest-DeleteServersTestJSON-805240055 Jun 22 10:22:07.032507 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Tenant-Id: 3e253dfe684b469383c18ff8c2a3dbd9 Jun 22 10:22:07.032507 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Tenant-Name: tempest-DeleteServersTestJSON-805240055 Jun 22 10:22:07.032507 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User: tempest-DeleteServersTestJSON-805240055-project Jun 22 10:22:07.032507 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Domain-Id: default Jun 22 10:22:07.032507 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Domain-Name: Default Jun 22 10:22:07.032507 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Id: 96d2a62272e248d3b11aca8737e22fb2 Jun 22 10:22:07.032507 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Name: tempest-DeleteServersTestJSON-805240055-project Jun 22 10:22:07.032507 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: method: > Jun 22 10:22:07.032507 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: exception: Instance 76efde76-215b-4c32-992f-3fe518470987 could not be found. Jun 22 10:22:07.032507 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: action_args: {'server_id': '76efde76-215b-4c32-992f-3fe518470987'} Jun 22 10:22:07.033227 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:22:07.033227 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:07.033227 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:22:07.033227 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:22:07.033227 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:22:07.033227 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:22:07.033227 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:22:07.033227 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:22:07.033227 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:22:07.033227 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:22:07.033227 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76efde76-215b-4c32-992f-3fe518470987 could not be found. Jun 22 10:22:07.033227 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:22:07.033227 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:22:07.033227 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:22:07.033227 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:07.033227 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:22:07.033227 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:22:07.033227 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:22:07.033227 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:22:07.033227 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:22:07.034758 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:22:07.034758 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 22 10:22:07.034758 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 10:22:07.034758 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 22 10:22:07.034758 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 10:22:07.034758 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 22 10:22:07.034758 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 22 10:22:07.034758 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:22:07.034758 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:22:07.034758 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76efde76-215b-4c32-992f-3fe518470987 could not be found. Jun 22 10:22:07.034758 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:22:07.034758 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:22:07.034758 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:22:07.034758 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:07.034758 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:22:07.034758 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:22:07.034758 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:22:07.034758 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:22:07.034758 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76efde76-215b-4c32-992f-3fe518470987 could not be found. Jun 22 10:22:07.034758 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:22:07.035866 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-3d249cb0-285b-4806-94cc-0758c731cbe5 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Returning 404 to user: Instance 76efde76-215b-4c32-992f-3fe518470987 could not be found. {{(pid=117679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:22:07.035866 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-3d249cb0-285b-4806-94cc-0758c731cbe5 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] 10.222.0.66 "GET /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.039157 Jun 22 10:22:07.035866 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 110/241] 10.222.0.66 () {58 vars in 1301 bytes} [Wed Jun 22 10:22:06 2022] GET /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987/os-volume_attachments => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 22 10:22:07.185744 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-a8d73af2-16ac-4c94-bc52-1367aa91168d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:07.186463 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-a8d73af2-16ac-4c94-bc52-1367aa91168d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:07.193530 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a8d73af2-16ac-4c94-bc52-1367aa91168d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:07.194066 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a8d73af2-16ac-4c94-bc52-1367aa91168d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:07.194921 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a8d73af2-16ac-4c94-bc52-1367aa91168d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:07.195488 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a8d73af2-16ac-4c94-bc52-1367aa91168d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:07.330399 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-a8d73af2-16ac-4c94-bc52-1367aa91168d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:07.338626 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-a8d73af2-16ac-4c94-bc52-1367aa91168d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1521 microversion: 2.1 time: 0.157922 Jun 22 10:22:07.339269 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 132/242] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:07 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:07.842894 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-672726b1-cf6d-4ce9-b285-880e1510d380 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:07.843456 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-672726b1-cf6d-4ce9-b285-880e1510d380 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 737e0985-7e40-4d2b-ad8e-81dbf965e1e3] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:07.851417 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-672726b1-cf6d-4ce9-b285-880e1510d380 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:07.851866 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-672726b1-cf6d-4ce9-b285-880e1510d380 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:07.852621 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-672726b1-cf6d-4ce9-b285-880e1510d380 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:07.853034 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-672726b1-cf6d-4ce9-b285-880e1510d380 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:07.913642 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-023b4205-ca8d-4e60-b260-2b6f8592c13d tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:07.914270 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-023b4205-ca8d-4e60-b260-2b6f8592c13d tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] [instance: c0b8e2b0-4292-43fa-8130-fa801fd2d223] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:07.921100 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-023b4205-ca8d-4e60-b260-2b6f8592c13d tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:07.921543 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-023b4205-ca8d-4e60-b260-2b6f8592c13d tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:07.922297 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-023b4205-ca8d-4e60-b260-2b6f8592c13d tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:07.922750 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-023b4205-ca8d-4e60-b260-2b6f8592c13d tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:08.002571 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-023b4205-ca8d-4e60-b260-2b6f8592c13d tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14092cdf420c419caa3c79434dee6194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe481a378f5454d975d405bc78d1203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:08.010611 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-023b4205-ca8d-4e60-b260-2b6f8592c13d tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] 10.222.0.66 "GET /compute/v2.1/servers/c0b8e2b0-4292-43fa-8130-fa801fd2d223" status: 200 len: 1429 microversion: 2.1 time: 0.100965 Jun 22 10:22:08.011194 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 133/243] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:07 2022] GET /compute/v2.1/servers/c0b8e2b0-4292-43fa-8130-fa801fd2d223 => generated 1429 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:08.020522 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-672726b1-cf6d-4ce9-b285-880e1510d380 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5370eb5245247a68d7f224cdd457ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:08.028226 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-672726b1-cf6d-4ce9-b285-880e1510d380 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3" status: 200 len: 1314 microversion: 2.1 time: 0.189462 Jun 22 10:22:08.028775 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 111/244] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:07 2022] GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:08.251290 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-7d546b94-ddec-47be-bd96-978adae84126 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:08.252129 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-7d546b94-ddec-47be-bd96-978adae84126 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] [instance: 76efde76-215b-4c32-992f-3fe518470987] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:08.264079 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7d546b94-ddec-47be-bd96-978adae84126 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:08.264522 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7d546b94-ddec-47be-bd96-978adae84126 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:08.265310 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7d546b94-ddec-47be-bd96-978adae84126 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:08.265881 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7d546b94-ddec-47be-bd96-978adae84126 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:08.280143 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.wsgi [None req-7d546b94-ddec-47be-bd96-978adae84126 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] HTTP exception thrown: Instance 76efde76-215b-4c32-992f-3fe518470987 could not be found. Jun 22 10:22:08.282166 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-7d546b94-ddec-47be-bd96-978adae84126 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Request method failure captured: Jun 22 10:22:08.282166 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: request: DELETE /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987 HTTP/1.1 Jun 22 10:22:08.282166 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Accept: application/json Jun 22 10:22:08.282166 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Accept-Encoding: identity Jun 22 10:22:08.282166 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Connection: close Jun 22 10:22:08.282166 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Content-Length: 0 Jun 22 10:22:08.282166 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Content-Type: application/json Jun 22 10:22:08.282166 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Host: 10.222.0.66 Jun 22 10:22:08.282166 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Openstack-System-Scope: None Jun 22 10:22:08.282166 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: User-Agent: python-urllib3/1.26.9 Jun 22 10:22:08.282166 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Auth-Token: gAAAAABisuz3jCzjNp2uB5daoLu33D_JnqhPYKeBFZuO3ASVj1_GI2kZZdluJPloddxKYOWSs0-X-U3vyyEZx4cf6hIAwvVxCHvxeQ_m3HqfsiSo78sTYdxLckIZdYja6rhugjsd7TSsIpDhCV_p0nUhxfIfO1tYos2MQvEwGbu3fuK6AUlmyE0 Jun 22 10:22:08.282166 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Domain-Id: None Jun 22 10:22:08.282166 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Domain-Name: None Jun 22 10:22:08.282166 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Identity-Status: Confirmed Jun 22 10:22:08.282166 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Is-Admin-Project: True Jun 22 10:22:08.282166 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Domain-Id: default Jun 22 10:22:08.282166 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Domain-Name: Default Jun 22 10:22:08.282166 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Id: 3e253dfe684b469383c18ff8c2a3dbd9 Jun 22 10:22:08.282166 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Name: tempest-DeleteServersTestJSON-805240055 Jun 22 10:22:08.282166 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Role: member,reader Jun 22 10:22:08.282166 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Roles: member,reader Jun 22 10:22:08.283569 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_3e253dfe684b469383c18ff8c2a3dbd9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3e253dfe684b469383c18ff8c2a3dbd9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/3e253dfe684b469383c18ff8c2a3dbd9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3e253dfe684b469383c18ff8c2a3dbd9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}] Jun 22 10:22:08.283569 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant: tempest-DeleteServersTestJSON-805240055 Jun 22 10:22:08.283569 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant-Id: 3e253dfe684b469383c18ff8c2a3dbd9 Jun 22 10:22:08.283569 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant-Name: tempest-DeleteServersTestJSON-805240055 Jun 22 10:22:08.283569 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User: tempest-DeleteServersTestJSON-805240055-project Jun 22 10:22:08.283569 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Domain-Id: default Jun 22 10:22:08.283569 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Domain-Name: Default Jun 22 10:22:08.283569 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Id: 96d2a62272e248d3b11aca8737e22fb2 Jun 22 10:22:08.283569 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Name: tempest-DeleteServersTestJSON-805240055-project Jun 22 10:22:08.283569 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: method: > Jun 22 10:22:08.283569 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: exception: Instance 76efde76-215b-4c32-992f-3fe518470987 could not be found. Jun 22 10:22:08.283569 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: action_args: {'id': '76efde76-215b-4c32-992f-3fe518470987'} Jun 22 10:22:08.285062 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:22:08.285062 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:08.285062 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:22:08.285062 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:22:08.285062 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:22:08.285062 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:22:08.285062 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:22:08.285062 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:22:08.285062 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:22:08.285062 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:22:08.285062 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76efde76-215b-4c32-992f-3fe518470987 could not be found. Jun 22 10:22:08.285062 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:22:08.285062 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:22:08.285062 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:22:08.285062 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:08.285062 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:22:08.285062 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:22:08.285062 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:22:08.285062 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:22:08.285062 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:22:08.286176 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:22:08.286176 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 10:22:08.286176 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 10:22:08.286176 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 10:22:08.286176 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 10:22:08.286176 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:22:08.286176 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:22:08.286176 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:22:08.286176 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:22:08.286176 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76efde76-215b-4c32-992f-3fe518470987 could not be found. Jun 22 10:22:08.286176 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:22:08.286176 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:22:08.286176 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:22:08.286176 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:08.286176 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:22:08.286176 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:22:08.286176 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:22:08.286176 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:22:08.286176 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76efde76-215b-4c32-992f-3fe518470987 could not be found. Jun 22 10:22:08.286176 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:22:08.287444 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-7d546b94-ddec-47be-bd96-978adae84126 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Returning 404 to user: Instance 76efde76-215b-4c32-992f-3fe518470987 could not be found. {{(pid=117680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:22:08.287444 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-7d546b94-ddec-47be-bd96-978adae84126 tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] 10.222.0.66 "DELETE /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987" status: 404 len: 111 microversion: 2.1 time: 0.039973 Jun 22 10:22:08.287444 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 134/245] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Jun 22 10:22:08 2022] DELETE /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:22:08.294170 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-2acf868a-1dbf-4f43-a61c-5162106fccbd tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:08.294170 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-2acf868a-1dbf-4f43-a61c-5162106fccbd tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] [instance: 76efde76-215b-4c32-992f-3fe518470987] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:08.299839 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2acf868a-1dbf-4f43-a61c-5162106fccbd tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:08.300303 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2acf868a-1dbf-4f43-a61c-5162106fccbd tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:08.301042 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2acf868a-1dbf-4f43-a61c-5162106fccbd tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:08.301494 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2acf868a-1dbf-4f43-a61c-5162106fccbd tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:08.316105 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.wsgi [None req-2acf868a-1dbf-4f43-a61c-5162106fccbd tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] HTTP exception thrown: Instance 76efde76-215b-4c32-992f-3fe518470987 could not be found. Jun 22 10:22:08.318311 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-2acf868a-1dbf-4f43-a61c-5162106fccbd tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Request method failure captured: Jun 22 10:22:08.318311 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: request: GET /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987 HTTP/1.1 Jun 22 10:22:08.318311 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Accept: application/json Jun 22 10:22:08.318311 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Accept-Encoding: identity Jun 22 10:22:08.318311 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Connection: close Jun 22 10:22:08.318311 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Content-Length: 0 Jun 22 10:22:08.318311 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Content-Type: application/json Jun 22 10:22:08.318311 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Host: 10.222.0.66 Jun 22 10:22:08.318311 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Openstack-System-Scope: None Jun 22 10:22:08.318311 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: User-Agent: python-urllib3/1.26.9 Jun 22 10:22:08.318311 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Auth-Token: gAAAAABisuz3jCzjNp2uB5daoLu33D_JnqhPYKeBFZuO3ASVj1_GI2kZZdluJPloddxKYOWSs0-X-U3vyyEZx4cf6hIAwvVxCHvxeQ_m3HqfsiSo78sTYdxLckIZdYja6rhugjsd7TSsIpDhCV_p0nUhxfIfO1tYos2MQvEwGbu3fuK6AUlmyE0 Jun 22 10:22:08.318311 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Domain-Id: None Jun 22 10:22:08.318311 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Domain-Name: None Jun 22 10:22:08.318311 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Identity-Status: Confirmed Jun 22 10:22:08.318311 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Is-Admin-Project: True Jun 22 10:22:08.318311 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Domain-Id: default Jun 22 10:22:08.318311 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Domain-Name: Default Jun 22 10:22:08.318311 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Id: 3e253dfe684b469383c18ff8c2a3dbd9 Jun 22 10:22:08.318311 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Name: tempest-DeleteServersTestJSON-805240055 Jun 22 10:22:08.318311 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Role: member,reader Jun 22 10:22:08.318311 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Roles: member,reader Jun 22 10:22:08.320663 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_3e253dfe684b469383c18ff8c2a3dbd9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3e253dfe684b469383c18ff8c2a3dbd9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/3e253dfe684b469383c18ff8c2a3dbd9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3e253dfe684b469383c18ff8c2a3dbd9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}] Jun 22 10:22:08.320663 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Tenant: tempest-DeleteServersTestJSON-805240055 Jun 22 10:22:08.320663 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Tenant-Id: 3e253dfe684b469383c18ff8c2a3dbd9 Jun 22 10:22:08.320663 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Tenant-Name: tempest-DeleteServersTestJSON-805240055 Jun 22 10:22:08.320663 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User: tempest-DeleteServersTestJSON-805240055-project Jun 22 10:22:08.320663 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Domain-Id: default Jun 22 10:22:08.320663 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Domain-Name: Default Jun 22 10:22:08.320663 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Id: 96d2a62272e248d3b11aca8737e22fb2 Jun 22 10:22:08.320663 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Name: tempest-DeleteServersTestJSON-805240055-project Jun 22 10:22:08.320663 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: method: > Jun 22 10:22:08.320663 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: exception: Instance 76efde76-215b-4c32-992f-3fe518470987 could not be found. Jun 22 10:22:08.320663 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: action_args: {'id': '76efde76-215b-4c32-992f-3fe518470987'} Jun 22 10:22:08.321714 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:22:08.321714 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:08.321714 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:22:08.321714 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:22:08.321714 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:22:08.321714 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:22:08.321714 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:22:08.321714 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:22:08.321714 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:22:08.321714 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:22:08.321714 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76efde76-215b-4c32-992f-3fe518470987 could not be found. Jun 22 10:22:08.321714 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:22:08.321714 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:22:08.321714 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:22:08.321714 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:08.321714 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:22:08.321714 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:22:08.321714 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:22:08.321714 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:22:08.321714 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:22:08.323835 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:22:08.323835 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:22:08.323835 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:22:08.323835 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:22:08.323835 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:22:08.323835 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:22:08.323835 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:22:08.323835 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76efde76-215b-4c32-992f-3fe518470987 could not be found. Jun 22 10:22:08.323835 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:22:08.323835 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:22:08.323835 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:22:08.323835 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:08.323835 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:22:08.323835 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:22:08.323835 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:22:08.323835 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:22:08.323835 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76efde76-215b-4c32-992f-3fe518470987 could not be found. Jun 22 10:22:08.323835 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:22:08.324824 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-2acf868a-1dbf-4f43-a61c-5162106fccbd tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] Returning 404 to user: Instance 76efde76-215b-4c32-992f-3fe518470987 could not be found. {{(pid=117679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:22:08.324824 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-2acf868a-1dbf-4f43-a61c-5162106fccbd tempest-DeleteServersTestJSON-805240055 tempest-DeleteServersTestJSON-805240055-project] 10.222.0.66 "GET /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987" status: 404 len: 111 microversion: 2.1 time: 0.031265 Jun 22 10:22:08.324824 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 112/246] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:08 2022] GET /compute/v2.1/servers/76efde76-215b-4c32-992f-3fe518470987 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:22:08.356115 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-036791c8-f7dc-448a-af22-9acc9f4288e9 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:08.356725 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-036791c8-f7dc-448a-af22-9acc9f4288e9 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:08.363407 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-036791c8-f7dc-448a-af22-9acc9f4288e9 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:08.363847 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-036791c8-f7dc-448a-af22-9acc9f4288e9 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:08.364616 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-036791c8-f7dc-448a-af22-9acc9f4288e9 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:08.365042 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-036791c8-f7dc-448a-af22-9acc9f4288e9 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:08.598422 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-036791c8-f7dc-448a-af22-9acc9f4288e9 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:08.608174 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-036791c8-f7dc-448a-af22-9acc9f4288e9 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1521 microversion: 2.1 time: 0.256175 Jun 22 10:22:08.608936 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 135/247] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:08 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1521 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:09.029062 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-e2d1cd77-4887-4fdf-99df-1700070b0f1c tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:09.029684 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-e2d1cd77-4887-4fdf-99df-1700070b0f1c tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] [instance: c0b8e2b0-4292-43fa-8130-fa801fd2d223] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:09.036561 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e2d1cd77-4887-4fdf-99df-1700070b0f1c tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:09.037014 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e2d1cd77-4887-4fdf-99df-1700070b0f1c tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:09.037950 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e2d1cd77-4887-4fdf-99df-1700070b0f1c tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:09.038304 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e2d1cd77-4887-4fdf-99df-1700070b0f1c tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:09.045350 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-def2a1ac-1df0-48fe-afd3-0738e82ed427 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:09.045945 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-def2a1ac-1df0-48fe-afd3-0738e82ed427 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 737e0985-7e40-4d2b-ad8e-81dbf965e1e3] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:09.052175 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-def2a1ac-1df0-48fe-afd3-0738e82ed427 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:09.052626 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-def2a1ac-1df0-48fe-afd3-0738e82ed427 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:09.053401 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-def2a1ac-1df0-48fe-afd3-0738e82ed427 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:09.053867 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-def2a1ac-1df0-48fe-afd3-0738e82ed427 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:09.129541 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-e2d1cd77-4887-4fdf-99df-1700070b0f1c tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14092cdf420c419caa3c79434dee6194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe481a378f5454d975d405bc78d1203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:09.137389 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-e2d1cd77-4887-4fdf-99df-1700070b0f1c tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] 10.222.0.66 "GET /compute/v2.1/servers/c0b8e2b0-4292-43fa-8130-fa801fd2d223" status: 200 len: 1429 microversion: 2.1 time: 0.112464 Jun 22 10:22:09.138011 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 113/248] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:09 2022] GET /compute/v2.1/servers/c0b8e2b0-4292-43fa-8130-fa801fd2d223 => generated 1429 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:09.282428 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-def2a1ac-1df0-48fe-afd3-0738e82ed427 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5370eb5245247a68d7f224cdd457ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:09.290422 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-def2a1ac-1df0-48fe-afd3-0738e82ed427 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3" status: 200 len: 1314 microversion: 2.1 time: 0.249012 Jun 22 10:22:09.291203 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 136/249] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:09 2022] GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3 => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:22:09.629206 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-357ebf46-bceb-4292-b9c6-3b6fde6c6633 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:09.629664 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-357ebf46-bceb-4292-b9c6-3b6fde6c6633 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:09.638119 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-357ebf46-bceb-4292-b9c6-3b6fde6c6633 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:09.638601 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-357ebf46-bceb-4292-b9c6-3b6fde6c6633 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:09.639394 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-357ebf46-bceb-4292-b9c6-3b6fde6c6633 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:09.639830 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-357ebf46-bceb-4292-b9c6-3b6fde6c6633 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:09.976005 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-357ebf46-bceb-4292-b9c6-3b6fde6c6633 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:09.984137 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-357ebf46-bceb-4292-b9c6-3b6fde6c6633 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1521 microversion: 2.1 time: 0.358940 Jun 22 10:22:09.984702 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 114/250] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:09 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1521 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:10.155902 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-6fba3cd1-60db-43af-906b-8cec69bd0467 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:10.156916 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-6fba3cd1-60db-43af-906b-8cec69bd0467 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] [instance: c0b8e2b0-4292-43fa-8130-fa801fd2d223] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:10.163849 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6fba3cd1-60db-43af-906b-8cec69bd0467 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:10.164303 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6fba3cd1-60db-43af-906b-8cec69bd0467 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:10.165138 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6fba3cd1-60db-43af-906b-8cec69bd0467 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:10.165581 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6fba3cd1-60db-43af-906b-8cec69bd0467 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:10.197193 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6fba3cd1-60db-43af-906b-8cec69bd0467 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:10.197855 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6fba3cd1-60db-43af-906b-8cec69bd0467 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:10.198709 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.objects.instance [None req-6fba3cd1-60db-43af-906b-8cec69bd0467 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lazy-loading 'fault' on Instance uuid c0b8e2b0-4292-43fa-8130-fa801fd2d223 {{(pid=117680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:22:10.252469 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-6fba3cd1-60db-43af-906b-8cec69bd0467 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14092cdf420c419caa3c79434dee6194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebe481a378f5454d975d405bc78d1203', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:10.260195 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-6fba3cd1-60db-43af-906b-8cec69bd0467 tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] 10.222.0.66 "GET /compute/v2.1/servers/c0b8e2b0-4292-43fa-8130-fa801fd2d223" status: 200 len: 1305 microversion: 2.1 time: 0.109061 Jun 22 10:22:10.260796 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 137/251] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:10 2022] GET /compute/v2.1/servers/c0b8e2b0-4292-43fa-8130-fa801fd2d223 => generated 1305 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:10.307659 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-11408e85-c02d-4124-920d-6cc61806247f tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:10.308276 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-11408e85-c02d-4124-920d-6cc61806247f tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 737e0985-7e40-4d2b-ad8e-81dbf965e1e3] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:10.319407 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-11408e85-c02d-4124-920d-6cc61806247f tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:10.319407 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-11408e85-c02d-4124-920d-6cc61806247f tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:10.319407 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-11408e85-c02d-4124-920d-6cc61806247f tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:10.319407 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-11408e85-c02d-4124-920d-6cc61806247f tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:10.323292 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_cell1:SELECT=100 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:10.487538 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-11408e85-c02d-4124-920d-6cc61806247f tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5370eb5245247a68d7f224cdd457ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:10.496880 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-11408e85-c02d-4124-920d-6cc61806247f tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3" status: 200 len: 1314 microversion: 2.1 time: 0.193268 Jun 22 10:22:10.498527 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 115/252] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:10 2022] GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:11.012757 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-457424b2-7baa-4ce0-9158-4dceaa4e4a1d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:11.014374 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-457424b2-7baa-4ce0-9158-4dceaa4e4a1d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:11.022598 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-457424b2-7baa-4ce0-9158-4dceaa4e4a1d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:11.023434 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-457424b2-7baa-4ce0-9158-4dceaa4e4a1d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:11.025224 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-457424b2-7baa-4ce0-9158-4dceaa4e4a1d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:11.026685 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-457424b2-7baa-4ce0-9158-4dceaa4e4a1d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:11.202889 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-457424b2-7baa-4ce0-9158-4dceaa4e4a1d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:11.212280 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-457424b2-7baa-4ce0-9158-4dceaa4e4a1d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1521 microversion: 2.1 time: 0.206840 Jun 22 10:22:11.213168 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 138/253] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:11 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:11.277264 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-a849c2f4-8ab6-4d6a-9084-cb76a2de65ad tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:11.277882 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-a849c2f4-8ab6-4d6a-9084-cb76a2de65ad tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] [instance: c0b8e2b0-4292-43fa-8130-fa801fd2d223] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:11.285446 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a849c2f4-8ab6-4d6a-9084-cb76a2de65ad tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:11.286991 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a849c2f4-8ab6-4d6a-9084-cb76a2de65ad tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:11.288055 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a849c2f4-8ab6-4d6a-9084-cb76a2de65ad tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:11.288897 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a849c2f4-8ab6-4d6a-9084-cb76a2de65ad tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:11.311189 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.wsgi [None req-a849c2f4-8ab6-4d6a-9084-cb76a2de65ad tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] HTTP exception thrown: Instance c0b8e2b0-4292-43fa-8130-fa801fd2d223 could not be found. Jun 22 10:22:11.314243 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-a849c2f4-8ab6-4d6a-9084-cb76a2de65ad tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Request method failure captured: Jun 22 10:22:11.314243 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: request: GET /compute/v2.1/servers/c0b8e2b0-4292-43fa-8130-fa801fd2d223 HTTP/1.1 Jun 22 10:22:11.314243 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Accept: application/json Jun 22 10:22:11.314243 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Accept-Encoding: identity Jun 22 10:22:11.314243 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Connection: close Jun 22 10:22:11.314243 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Content-Length: 0 Jun 22 10:22:11.314243 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Content-Type: application/json Jun 22 10:22:11.314243 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Host: 10.222.0.66 Jun 22 10:22:11.314243 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Openstack-System-Scope: None Jun 22 10:22:11.314243 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: User-Agent: python-urllib3/1.26.9 Jun 22 10:22:11.314243 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Auth-Token: gAAAAABisu0wrfjXnQg4HZHFEgz_OZkRZdAd56STjc_Q0DU6IRhTQZ3LdVdtfEU5v-XFIn51IM9QKBOXJpVHSRbkqDyjEIh_cDU8msrOxM_sGMFSFr0uSuxUFNC3aSnDSJGn8yTOhm7XfE64MEugnlymabh_u5IypcEtybJqFjF2FyfAWLPGNMs Jun 22 10:22:11.314243 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Domain-Id: None Jun 22 10:22:11.314243 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Domain-Name: None Jun 22 10:22:11.314243 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Identity-Status: Confirmed Jun 22 10:22:11.314243 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Is-Admin-Project: True Jun 22 10:22:11.314243 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Domain-Id: default Jun 22 10:22:11.314243 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Domain-Name: Default Jun 22 10:22:11.314243 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Id: ebe481a378f5454d975d405bc78d1203 Jun 22 10:22:11.314243 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Name: tempest-VolumesNegativeTest-1785026421 Jun 22 10:22:11.314243 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Role: member,reader Jun 22 10:22:11.314243 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Roles: member,reader Jun 22 10:22:11.315642 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_ebe481a378f5454d975d405bc78d1203"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ebe481a378f5454d975d405bc78d1203"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/ebe481a378f5454d975d405bc78d1203"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/ebe481a378f5454d975d405bc78d1203"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}] Jun 22 10:22:11.315642 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Tenant: tempest-VolumesNegativeTest-1785026421 Jun 22 10:22:11.315642 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Tenant-Id: ebe481a378f5454d975d405bc78d1203 Jun 22 10:22:11.315642 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Tenant-Name: tempest-VolumesNegativeTest-1785026421 Jun 22 10:22:11.315642 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User: tempest-VolumesNegativeTest-1785026421-project Jun 22 10:22:11.315642 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Domain-Id: default Jun 22 10:22:11.315642 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Domain-Name: Default Jun 22 10:22:11.315642 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Id: 14092cdf420c419caa3c79434dee6194 Jun 22 10:22:11.315642 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Name: tempest-VolumesNegativeTest-1785026421-project Jun 22 10:22:11.315642 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: method: > Jun 22 10:22:11.315642 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: exception: Instance c0b8e2b0-4292-43fa-8130-fa801fd2d223 could not be found. Jun 22 10:22:11.315642 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: action_args: {'id': 'c0b8e2b0-4292-43fa-8130-fa801fd2d223'} Jun 22 10:22:11.316373 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:22:11.316373 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:11.316373 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:22:11.316373 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:22:11.316373 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:22:11.316373 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:22:11.316373 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:22:11.316373 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:22:11.316373 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:22:11.316373 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:22:11.316373 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0b8e2b0-4292-43fa-8130-fa801fd2d223 could not be found. Jun 22 10:22:11.316373 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:22:11.316373 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:22:11.316373 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:22:11.316373 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:11.316373 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:22:11.316373 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:22:11.316373 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:22:11.316373 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:22:11.316373 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:22:11.317683 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:22:11.317683 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:22:11.317683 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:22:11.317683 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:22:11.317683 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:22:11.317683 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:22:11.317683 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:22:11.317683 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0b8e2b0-4292-43fa-8130-fa801fd2d223 could not be found. Jun 22 10:22:11.317683 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:22:11.317683 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:22:11.317683 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:22:11.317683 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:11.317683 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:22:11.317683 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:22:11.317683 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:22:11.317683 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:22:11.317683 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0b8e2b0-4292-43fa-8130-fa801fd2d223 could not be found. Jun 22 10:22:11.317683 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:22:11.318835 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-a849c2f4-8ab6-4d6a-9084-cb76a2de65ad tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] Returning 404 to user: Instance c0b8e2b0-4292-43fa-8130-fa801fd2d223 could not be found. {{(pid=117679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:22:11.318835 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-a849c2f4-8ab6-4d6a-9084-cb76a2de65ad tempest-VolumesNegativeTest-1785026421 tempest-VolumesNegativeTest-1785026421-project] 10.222.0.66 "GET /compute/v2.1/servers/c0b8e2b0-4292-43fa-8130-fa801fd2d223" status: 404 len: 111 microversion: 2.1 time: 0.041232 Jun 22 10:22:11.318835 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 116/254] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:11 2022] GET /compute/v2.1/servers/c0b8e2b0-4292-43fa-8130-fa801fd2d223 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:22:11.515568 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-4166b804-30b4-4791-a5e1-5e3934a8eb91 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:11.516149 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-4166b804-30b4-4791-a5e1-5e3934a8eb91 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 737e0985-7e40-4d2b-ad8e-81dbf965e1e3] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:11.527050 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4166b804-30b4-4791-a5e1-5e3934a8eb91 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:11.527788 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4166b804-30b4-4791-a5e1-5e3934a8eb91 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:11.528796 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4166b804-30b4-4791-a5e1-5e3934a8eb91 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:11.530393 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4166b804-30b4-4791-a5e1-5e3934a8eb91 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:11.712772 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-4166b804-30b4-4791-a5e1-5e3934a8eb91 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5370eb5245247a68d7f224cdd457ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:11.726312 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-4166b804-30b4-4791-a5e1-5e3934a8eb91 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3" status: 200 len: 1314 microversion: 2.1 time: 0.215444 Jun 22 10:22:11.728683 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 139/255] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:11 2022] GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:12.234958 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-09a0ed6d-d16a-4e4b-b431-bf91e9de11a3 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:12.234958 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-09a0ed6d-d16a-4e4b-b431-bf91e9de11a3 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:12.241748 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-09a0ed6d-d16a-4e4b-b431-bf91e9de11a3 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:12.242779 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-09a0ed6d-d16a-4e4b-b431-bf91e9de11a3 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:12.243058 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-09a0ed6d-d16a-4e4b-b431-bf91e9de11a3 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:12.243497 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-09a0ed6d-d16a-4e4b-b431-bf91e9de11a3 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:12.477858 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-09a0ed6d-d16a-4e4b-b431-bf91e9de11a3 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:12.487471 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-09a0ed6d-d16a-4e4b-b431-bf91e9de11a3 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1521 microversion: 2.1 time: 0.259491 Jun 22 10:22:12.489042 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 117/256] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:12 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1521 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:12.744690 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-6f2ee61e-a019-423d-a482-7f51a7c241bb tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:12.746292 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-6f2ee61e-a019-423d-a482-7f51a7c241bb tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 737e0985-7e40-4d2b-ad8e-81dbf965e1e3] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:12.753824 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6f2ee61e-a019-423d-a482-7f51a7c241bb tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:12.753824 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6f2ee61e-a019-423d-a482-7f51a7c241bb tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:12.754994 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6f2ee61e-a019-423d-a482-7f51a7c241bb tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:12.755517 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6f2ee61e-a019-423d-a482-7f51a7c241bb tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:12.930098 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-6f2ee61e-a019-423d-a482-7f51a7c241bb tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5370eb5245247a68d7f224cdd457ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:12.938277 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-6f2ee61e-a019-423d-a482-7f51a7c241bb tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3" status: 200 len: 1314 microversion: 2.1 time: 0.198143 Jun 22 10:22:12.947685 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 140/257] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:12 2022] GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3 => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:13.509123 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-6eb7d0c1-77e7-45a8-9a72-a2a78b891130 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:13.509968 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-6eb7d0c1-77e7-45a8-9a72-a2a78b891130 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:13.517933 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6eb7d0c1-77e7-45a8-9a72-a2a78b891130 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:13.518393 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6eb7d0c1-77e7-45a8-9a72-a2a78b891130 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:13.519329 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6eb7d0c1-77e7-45a8-9a72-a2a78b891130 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:13.519940 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6eb7d0c1-77e7-45a8-9a72-a2a78b891130 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:13.678804 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-6eb7d0c1-77e7-45a8-9a72-a2a78b891130 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:13.691866 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-6eb7d0c1-77e7-45a8-9a72-a2a78b891130 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1521 microversion: 2.1 time: 0.190376 Jun 22 10:22:13.692995 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 118/258] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:13 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:13.954487 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-6841d8fc-b6f3-40fa-a4b6-3a17e03e7a85 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:13.955732 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-6841d8fc-b6f3-40fa-a4b6-3a17e03e7a85 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 737e0985-7e40-4d2b-ad8e-81dbf965e1e3] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:13.961948 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6841d8fc-b6f3-40fa-a4b6-3a17e03e7a85 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:13.962632 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6841d8fc-b6f3-40fa-a4b6-3a17e03e7a85 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:13.963426 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6841d8fc-b6f3-40fa-a4b6-3a17e03e7a85 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:13.963864 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6841d8fc-b6f3-40fa-a4b6-3a17e03e7a85 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:14.119456 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-6841d8fc-b6f3-40fa-a4b6-3a17e03e7a85 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5370eb5245247a68d7f224cdd457ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:14.127949 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-6841d8fc-b6f3-40fa-a4b6-3a17e03e7a85 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3" status: 200 len: 1314 microversion: 2.1 time: 0.177628 Jun 22 10:22:14.128914 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 141/259] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:13 2022] GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:14.709990 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-47539cab-0ad9-4430-bf9e-b1ee665a7ff9 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:14.710624 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-47539cab-0ad9-4430-bf9e-b1ee665a7ff9 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:14.717870 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-47539cab-0ad9-4430-bf9e-b1ee665a7ff9 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:14.718298 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-47539cab-0ad9-4430-bf9e-b1ee665a7ff9 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:14.719388 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-47539cab-0ad9-4430-bf9e-b1ee665a7ff9 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:14.719861 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-47539cab-0ad9-4430-bf9e-b1ee665a7ff9 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:14.879611 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-47539cab-0ad9-4430-bf9e-b1ee665a7ff9 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:14.887677 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-47539cab-0ad9-4430-bf9e-b1ee665a7ff9 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1521 microversion: 2.1 time: 0.182685 Jun 22 10:22:14.888447 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 119/260] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:14 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:15.145366 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-e6e0fecf-11b9-4956-ba5d-9c08e5eae66f tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:15.145999 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-e6e0fecf-11b9-4956-ba5d-9c08e5eae66f tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 737e0985-7e40-4d2b-ad8e-81dbf965e1e3] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:15.152445 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e6e0fecf-11b9-4956-ba5d-9c08e5eae66f tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:15.153074 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e6e0fecf-11b9-4956-ba5d-9c08e5eae66f tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:15.153890 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e6e0fecf-11b9-4956-ba5d-9c08e5eae66f tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:15.154326 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e6e0fecf-11b9-4956-ba5d-9c08e5eae66f tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:15.288915 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-e6e0fecf-11b9-4956-ba5d-9c08e5eae66f tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5370eb5245247a68d7f224cdd457ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:15.296579 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-e6e0fecf-11b9-4956-ba5d-9c08e5eae66f tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3" status: 200 len: 1314 microversion: 2.1 time: 0.155159 Jun 22 10:22:15.297149 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 142/261] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:15 2022] GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:15.906872 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-7d4371bd-a563-4009-b0b7-b954fb20edc1 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:15.907482 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-7d4371bd-a563-4009-b0b7-b954fb20edc1 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:15.914529 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7d4371bd-a563-4009-b0b7-b954fb20edc1 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:15.914987 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7d4371bd-a563-4009-b0b7-b954fb20edc1 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:15.915887 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7d4371bd-a563-4009-b0b7-b954fb20edc1 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:15.916320 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7d4371bd-a563-4009-b0b7-b954fb20edc1 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:16.062127 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-7d4371bd-a563-4009-b0b7-b954fb20edc1 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:16.070328 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-7d4371bd-a563-4009-b0b7-b954fb20edc1 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1521 microversion: 2.1 time: 0.167956 Jun 22 10:22:16.070933 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 120/262] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:15 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:16.315827 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-cca54346-ef76-413e-93e2-83d92ba73a6f tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:16.316395 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-cca54346-ef76-413e-93e2-83d92ba73a6f tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 737e0985-7e40-4d2b-ad8e-81dbf965e1e3] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:16.324295 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-cca54346-ef76-413e-93e2-83d92ba73a6f tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:16.324739 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-cca54346-ef76-413e-93e2-83d92ba73a6f tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:16.325510 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-cca54346-ef76-413e-93e2-83d92ba73a6f tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:16.325970 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-cca54346-ef76-413e-93e2-83d92ba73a6f tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:16.461159 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-cca54346-ef76-413e-93e2-83d92ba73a6f tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5370eb5245247a68d7f224cdd457ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:16.468982 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-cca54346-ef76-413e-93e2-83d92ba73a6f tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3" status: 200 len: 1314 microversion: 2.1 time: 0.157937 Jun 22 10:22:16.469558 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 143/263] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:16 2022] GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:17.088036 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-ec4e29a3-c295-4590-877b-968ae9408f6b tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:17.088619 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-ec4e29a3-c295-4590-877b-968ae9408f6b tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:17.095659 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ec4e29a3-c295-4590-877b-968ae9408f6b tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:17.096103 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ec4e29a3-c295-4590-877b-968ae9408f6b tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:17.096877 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ec4e29a3-c295-4590-877b-968ae9408f6b tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:17.097308 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ec4e29a3-c295-4590-877b-968ae9408f6b tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:17.236576 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-ec4e29a3-c295-4590-877b-968ae9408f6b tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:17.244288 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-ec4e29a3-c295-4590-877b-968ae9408f6b tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1521 microversion: 2.1 time: 0.160455 Jun 22 10:22:17.244876 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 121/264] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:17 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:17.374446 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-8b2942d3-bac2-4a07-bad1-6d8a05c83585 req-2dececee-c9d7-40e5-9b2d-93a1362d940d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "737e0985-7e40-4d2b-ad8e-81dbf965e1e3", "name": "network-vif-plugged", "status": "completed", "tag": "8aab1b56-8fc8-4c1b-9126-4d9686689409"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:22:17.387100 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-8b2942d3-bac2-4a07-bad1-6d8a05c83585 req-2dececee-c9d7-40e5-9b2d-93a1362d940d service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:17.387794 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-8b2942d3-bac2-4a07-bad1-6d8a05c83585 req-2dececee-c9d7-40e5-9b2d-93a1362d940d service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:17.400369 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-8b2942d3-bac2-4a07-bad1-6d8a05c83585 req-2dececee-c9d7-40e5-9b2d-93a1362d940d service nova] Creating event network-vif-plugged:8aab1b56-8fc8-4c1b-9126-4d9686689409 for instance 737e0985-7e40-4d2b-ad8e-81dbf965e1e3 on hv-cinder-84713 Jun 22 10:22:17.406198 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-8b2942d3-bac2-4a07-bad1-6d8a05c83585 req-2dececee-c9d7-40e5-9b2d-93a1362d940d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035218 Jun 22 10:22:17.407227 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 144/265] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:22:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:22:17.485599 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-5433e131-4e94-4f8c-971b-5e40b8b42b5f tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:17.486332 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-5433e131-4e94-4f8c-971b-5e40b8b42b5f tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 737e0985-7e40-4d2b-ad8e-81dbf965e1e3] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:17.493143 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5433e131-4e94-4f8c-971b-5e40b8b42b5f tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:17.493618 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5433e131-4e94-4f8c-971b-5e40b8b42b5f tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:17.494397 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5433e131-4e94-4f8c-971b-5e40b8b42b5f tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:17.494879 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5433e131-4e94-4f8c-971b-5e40b8b42b5f tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:17.688789 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-5433e131-4e94-4f8c-971b-5e40b8b42b5f tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5370eb5245247a68d7f224cdd457ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:17.696555 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-5433e131-4e94-4f8c-971b-5e40b8b42b5f tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3" status: 200 len: 1314 microversion: 2.1 time: 0.214848 Jun 22 10:22:17.697249 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 122/266] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:17 2022] GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:18.263517 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-3c2b3fc7-984e-4f1a-abbc-b3fe0194f0c7 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:18.265551 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-3c2b3fc7-984e-4f1a-abbc-b3fe0194f0c7 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:18.272342 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3c2b3fc7-984e-4f1a-abbc-b3fe0194f0c7 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:18.272792 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3c2b3fc7-984e-4f1a-abbc-b3fe0194f0c7 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:18.273558 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3c2b3fc7-984e-4f1a-abbc-b3fe0194f0c7 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:18.273987 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3c2b3fc7-984e-4f1a-abbc-b3fe0194f0c7 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:18.415197 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-3c2b3fc7-984e-4f1a-abbc-b3fe0194f0c7 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:18.422989 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-3c2b3fc7-984e-4f1a-abbc-b3fe0194f0c7 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1521 microversion: 2.1 time: 0.165112 Jun 22 10:22:18.423554 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 145/267] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:18 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:18.716131 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-5c03136b-5815-4dc0-a6fc-425a8fdf7b57 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:18.716799 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-5c03136b-5815-4dc0-a6fc-425a8fdf7b57 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 737e0985-7e40-4d2b-ad8e-81dbf965e1e3] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:18.723639 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5c03136b-5815-4dc0-a6fc-425a8fdf7b57 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:18.724090 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5c03136b-5815-4dc0-a6fc-425a8fdf7b57 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:18.724888 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5c03136b-5815-4dc0-a6fc-425a8fdf7b57 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:18.725324 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5c03136b-5815-4dc0-a6fc-425a8fdf7b57 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:18.861906 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-5c03136b-5815-4dc0-a6fc-425a8fdf7b57 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5370eb5245247a68d7f224cdd457ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:18.870349 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-5c03136b-5815-4dc0-a6fc-425a8fdf7b57 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3" status: 200 len: 1314 microversion: 2.1 time: 0.158735 Jun 22 10:22:18.870916 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 123/268] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:18 2022] GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:19.441114 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-9c82acd5-15f6-4e49-8cd9-c900a48f2182 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:19.442363 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-9c82acd5-15f6-4e49-8cd9-c900a48f2182 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:19.448938 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9c82acd5-15f6-4e49-8cd9-c900a48f2182 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:19.449390 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9c82acd5-15f6-4e49-8cd9-c900a48f2182 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:19.450160 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9c82acd5-15f6-4e49-8cd9-c900a48f2182 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:19.450613 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9c82acd5-15f6-4e49-8cd9-c900a48f2182 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:19.602187 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-9c82acd5-15f6-4e49-8cd9-c900a48f2182 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:19.609925 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-9c82acd5-15f6-4e49-8cd9-c900a48f2182 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1521 microversion: 2.1 time: 0.173520 Jun 22 10:22:19.610491 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 146/269] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:19 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:19.887675 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-611bc56e-278f-4821-b3c0-5f7238323054 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:19.888263 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-611bc56e-278f-4821-b3c0-5f7238323054 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 737e0985-7e40-4d2b-ad8e-81dbf965e1e3] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:19.895421 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-611bc56e-278f-4821-b3c0-5f7238323054 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:19.895859 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-611bc56e-278f-4821-b3c0-5f7238323054 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:19.896616 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-611bc56e-278f-4821-b3c0-5f7238323054 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:19.897072 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-611bc56e-278f-4821-b3c0-5f7238323054 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:20.029496 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-611bc56e-278f-4821-b3c0-5f7238323054 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5370eb5245247a68d7f224cdd457ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:20.037813 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-611bc56e-278f-4821-b3c0-5f7238323054 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3" status: 200 len: 1314 microversion: 2.1 time: 0.154162 Jun 22 10:22:20.038348 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 124/270] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:19 2022] GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:20.627802 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-4b6b5a55-21aa-4b54-a90d-547b00a35099 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:20.628411 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-4b6b5a55-21aa-4b54-a90d-547b00a35099 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:20.635671 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4b6b5a55-21aa-4b54-a90d-547b00a35099 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:20.636117 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4b6b5a55-21aa-4b54-a90d-547b00a35099 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:20.636953 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4b6b5a55-21aa-4b54-a90d-547b00a35099 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:20.637384 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4b6b5a55-21aa-4b54-a90d-547b00a35099 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:20.794432 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-4b6b5a55-21aa-4b54-a90d-547b00a35099 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:20.798127 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:SELECT=100 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:20.803384 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-4b6b5a55-21aa-4b54-a90d-547b00a35099 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1521 microversion: 2.1 time: 0.180367 Jun 22 10:22:20.803970 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 147/271] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:20 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:21.055138 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-c4e6532c-213f-4986-b675-f185df11e356 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:21.055966 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-c4e6532c-213f-4986-b675-f185df11e356 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 737e0985-7e40-4d2b-ad8e-81dbf965e1e3] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:21.062659 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c4e6532c-213f-4986-b675-f185df11e356 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:21.063102 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c4e6532c-213f-4986-b675-f185df11e356 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:21.063850 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c4e6532c-213f-4986-b675-f185df11e356 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:21.064467 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c4e6532c-213f-4986-b675-f185df11e356 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:21.214046 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-c4e6532c-213f-4986-b675-f185df11e356 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5370eb5245247a68d7f224cdd457ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:21.222302 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-c4e6532c-213f-4986-b675-f185df11e356 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3" status: 200 len: 1314 microversion: 2.1 time: 0.171061 Jun 22 10:22:21.222922 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 125/272] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:21 2022] GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:21.822572 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-14f155b1-bc6b-4aac-9cd1-61c687184466 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:21.824150 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-14f155b1-bc6b-4aac-9cd1-61c687184466 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:21.830567 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-14f155b1-bc6b-4aac-9cd1-61c687184466 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:21.830992 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-14f155b1-bc6b-4aac-9cd1-61c687184466 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:21.832083 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-14f155b1-bc6b-4aac-9cd1-61c687184466 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:21.832519 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-14f155b1-bc6b-4aac-9cd1-61c687184466 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:21.987679 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-14f155b1-bc6b-4aac-9cd1-61c687184466 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:21.996815 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-14f155b1-bc6b-4aac-9cd1-61c687184466 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1521 microversion: 2.1 time: 0.179254 Jun 22 10:22:21.997784 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 148/273] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:21 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:22.240537 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-fdbbb8d4-c330-4b41-a1d3-c63740dfb678 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:22.241435 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-fdbbb8d4-c330-4b41-a1d3-c63740dfb678 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 737e0985-7e40-4d2b-ad8e-81dbf965e1e3] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:22.249188 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-fdbbb8d4-c330-4b41-a1d3-c63740dfb678 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:22.249640 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-fdbbb8d4-c330-4b41-a1d3-c63740dfb678 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:22.250425 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-fdbbb8d4-c330-4b41-a1d3-c63740dfb678 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:22.250879 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-fdbbb8d4-c330-4b41-a1d3-c63740dfb678 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:22.401986 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-fdbbb8d4-c330-4b41-a1d3-c63740dfb678 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5370eb5245247a68d7f224cdd457ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:22.411267 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-fdbbb8d4-c330-4b41-a1d3-c63740dfb678 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3" status: 200 len: 1314 microversion: 2.1 time: 0.175435 Jun 22 10:22:22.411859 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 126/274] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:22 2022] GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:23.016227 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-e2276214-5692-4921-ab2c-d66316dbaf21 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:23.016978 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-e2276214-5692-4921-ab2c-d66316dbaf21 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:23.024173 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e2276214-5692-4921-ab2c-d66316dbaf21 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:23.024956 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e2276214-5692-4921-ab2c-d66316dbaf21 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:23.026025 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e2276214-5692-4921-ab2c-d66316dbaf21 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:23.026663 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e2276214-5692-4921-ab2c-d66316dbaf21 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:23.187690 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-e2276214-5692-4921-ab2c-d66316dbaf21 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:23.196139 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-e2276214-5692-4921-ab2c-d66316dbaf21 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1521 microversion: 2.1 time: 0.186529 Jun 22 10:22:23.196935 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 149/275] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:23 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:23.428763 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-ede917b3-5267-4d6c-a304-01c53ad89a16 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:23.429508 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-ede917b3-5267-4d6c-a304-01c53ad89a16 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 737e0985-7e40-4d2b-ad8e-81dbf965e1e3] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:23.436709 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ede917b3-5267-4d6c-a304-01c53ad89a16 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:23.437073 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ede917b3-5267-4d6c-a304-01c53ad89a16 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:23.438079 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ede917b3-5267-4d6c-a304-01c53ad89a16 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:23.438456 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ede917b3-5267-4d6c-a304-01c53ad89a16 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:23.587415 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-ede917b3-5267-4d6c-a304-01c53ad89a16 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5370eb5245247a68d7f224cdd457ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:23.595319 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-ede917b3-5267-4d6c-a304-01c53ad89a16 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3" status: 200 len: 1314 microversion: 2.1 time: 0.170662 Jun 22 10:22:23.595913 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 127/276] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:23 2022] GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:24.214065 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-f497f945-0b2c-42c3-85f5-725cc1567c97 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:24.215037 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-f497f945-0b2c-42c3-85f5-725cc1567c97 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:24.221695 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f497f945-0b2c-42c3-85f5-725cc1567c97 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:24.222269 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f497f945-0b2c-42c3-85f5-725cc1567c97 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:24.223123 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f497f945-0b2c-42c3-85f5-725cc1567c97 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:24.223615 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f497f945-0b2c-42c3-85f5-725cc1567c97 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:24.445243 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-f497f945-0b2c-42c3-85f5-725cc1567c97 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:24.453961 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-f497f945-0b2c-42c3-85f5-725cc1567c97 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1521 microversion: 2.1 time: 0.243845 Jun 22 10:22:24.454936 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 150/277] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:24 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:24.611677 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-fbb27cce-5b00-4945-b3a6-b10d9d9b375b tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:24.612297 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-fbb27cce-5b00-4945-b3a6-b10d9d9b375b tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 737e0985-7e40-4d2b-ad8e-81dbf965e1e3] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:24.619188 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-fbb27cce-5b00-4945-b3a6-b10d9d9b375b tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:24.619853 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-fbb27cce-5b00-4945-b3a6-b10d9d9b375b tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:24.620777 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-fbb27cce-5b00-4945-b3a6-b10d9d9b375b tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:24.621341 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-fbb27cce-5b00-4945-b3a6-b10d9d9b375b tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:24.887167 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-fbb27cce-5b00-4945-b3a6-b10d9d9b375b tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5370eb5245247a68d7f224cdd457ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:24.908122 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-fbb27cce-5b00-4945-b3a6-b10d9d9b375b tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3" status: 200 len: 1314 microversion: 2.1 time: 0.300046 Jun 22 10:22:24.908900 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 128/278] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:24 2022] GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3 => generated 1314 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:25.475186 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-0fa80d5b-82e8-4312-aa10-61d11b4e422b tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:25.477800 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-0fa80d5b-82e8-4312-aa10-61d11b4e422b tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:25.485005 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0fa80d5b-82e8-4312-aa10-61d11b4e422b tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:25.485456 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0fa80d5b-82e8-4312-aa10-61d11b4e422b tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:25.486264 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0fa80d5b-82e8-4312-aa10-61d11b4e422b tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:25.486752 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0fa80d5b-82e8-4312-aa10-61d11b4e422b tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:25.743671 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-0fa80d5b-82e8-4312-aa10-61d11b4e422b tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:25.752197 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-0fa80d5b-82e8-4312-aa10-61d11b4e422b tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1521 microversion: 2.1 time: 0.283017 Jun 22 10:22:25.753013 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 151/279] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:25 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1521 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:25.925269 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-a9f96d4c-30a7-47f9-ae73-a0095c292dec tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:25.926477 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-a9f96d4c-30a7-47f9-ae73-a0095c292dec tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 737e0985-7e40-4d2b-ad8e-81dbf965e1e3] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:25.942678 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a9f96d4c-30a7-47f9-ae73-a0095c292dec tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:25.943119 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a9f96d4c-30a7-47f9-ae73-a0095c292dec tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:25.943890 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a9f96d4c-30a7-47f9-ae73-a0095c292dec tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:25.944311 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a9f96d4c-30a7-47f9-ae73-a0095c292dec tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:26.371581 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-a9f96d4c-30a7-47f9-ae73-a0095c292dec tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5370eb5245247a68d7f224cdd457ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:26.380802 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-a9f96d4c-30a7-47f9-ae73-a0095c292dec tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3" status: 200 len: 1499 microversion: 2.1 time: 0.459338 Jun 22 10:22:26.381641 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 129/280] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:25 2022] GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3 => generated 1499 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:26.770746 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-1c185782-0aed-47a1-9147-58640c42509a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:26.772114 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-1c185782-0aed-47a1-9147-58640c42509a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:26.784077 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1c185782-0aed-47a1-9147-58640c42509a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:26.788836 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1c185782-0aed-47a1-9147-58640c42509a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:26.790331 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1c185782-0aed-47a1-9147-58640c42509a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:26.791411 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1c185782-0aed-47a1-9147-58640c42509a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:27.141912 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-ad55cb54-6266-4f8f-a01b-2074a33d38c4 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:27.142475 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-ad55cb54-6266-4f8f-a01b-2074a33d38c4 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 737e0985-7e40-4d2b-ad8e-81dbf965e1e3] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:27.152213 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ad55cb54-6266-4f8f-a01b-2074a33d38c4 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:27.152669 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ad55cb54-6266-4f8f-a01b-2074a33d38c4 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:27.153463 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ad55cb54-6266-4f8f-a01b-2074a33d38c4 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:27.153927 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ad55cb54-6266-4f8f-a01b-2074a33d38c4 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:27.210323 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-1c185782-0aed-47a1-9147-58640c42509a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:27.215798 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-ad55cb54-6266-4f8f-a01b-2074a33d38c4 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 737e0985-7e40-4d2b-ad8e-81dbf965e1e3] Going to try to terminate instance {{(pid=117679) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 10:22:27.218987 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-1c185782-0aed-47a1-9147-58640c42509a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1521 microversion: 2.1 time: 0.453091 Jun 22 10:22:27.221569 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 152/281] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:26 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1521 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:22:27.337085 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:27.397899 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-ad55cb54-6266-4f8f-a01b-2074a33d38c4 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "DELETE /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3" status: 204 len: 0 microversion: 2.1 time: 0.267326 Jun 22 10:22:27.399868 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 130/282] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Jun 22 10:22:27 2022] DELETE /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 22 10:22:27.416810 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-d76bab24-6d0b-47ff-8c5d-8e6679b807b5 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:27.417433 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-d76bab24-6d0b-47ff-8c5d-8e6679b807b5 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 737e0985-7e40-4d2b-ad8e-81dbf965e1e3] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:27.429907 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d76bab24-6d0b-47ff-8c5d-8e6679b807b5 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:27.430488 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d76bab24-6d0b-47ff-8c5d-8e6679b807b5 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:27.431464 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d76bab24-6d0b-47ff-8c5d-8e6679b807b5 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:27.432081 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d76bab24-6d0b-47ff-8c5d-8e6679b807b5 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:27.651335 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-d76bab24-6d0b-47ff-8c5d-8e6679b807b5 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5370eb5245247a68d7f224cdd457ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:27.662902 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-d76bab24-6d0b-47ff-8c5d-8e6679b807b5 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3" status: 200 len: 1505 microversion: 2.1 time: 0.256061 Jun 22 10:22:27.664119 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 153/283] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:27 2022] GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3 => generated 1505 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:22:28.238701 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-e58c49d2-974b-45bb-901f-1336036b94f2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:28.239896 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-e58c49d2-974b-45bb-901f-1336036b94f2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:28.250434 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e58c49d2-974b-45bb-901f-1336036b94f2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:28.250931 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e58c49d2-974b-45bb-901f-1336036b94f2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:28.251724 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e58c49d2-974b-45bb-901f-1336036b94f2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:28.252159 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e58c49d2-974b-45bb-901f-1336036b94f2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:28.445212 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-e58c49d2-974b-45bb-901f-1336036b94f2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:28.459228 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-e58c49d2-974b-45bb-901f-1336036b94f2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1521 microversion: 2.1 time: 0.225450 Jun 22 10:22:28.465100 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 131/284] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:28 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:28.681362 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-dd829a9c-9510-48de-abe4-d71d3b2f625f tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:28.682134 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-dd829a9c-9510-48de-abe4-d71d3b2f625f tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 737e0985-7e40-4d2b-ad8e-81dbf965e1e3] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:28.689003 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-dd829a9c-9510-48de-abe4-d71d3b2f625f tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:28.689374 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-dd829a9c-9510-48de-abe4-d71d3b2f625f tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:28.690357 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-dd829a9c-9510-48de-abe4-d71d3b2f625f tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:28.690865 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-dd829a9c-9510-48de-abe4-d71d3b2f625f tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:28.881158 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-dd829a9c-9510-48de-abe4-d71d3b2f625f tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5370eb5245247a68d7f224cdd457ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:28.891409 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-dd829a9c-9510-48de-abe4-d71d3b2f625f tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3" status: 200 len: 1505 microversion: 2.1 time: 0.214306 Jun 22 10:22:28.903377 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 154/285] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:28 2022] GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3 => generated 1505 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:29.479986 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-8e528baf-a283-4092-af62-f1593beac989 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:29.484955 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-8e528baf-a283-4092-af62-f1593beac989 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:29.491313 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=2 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:29.504087 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8e528baf-a283-4092-af62-f1593beac989 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:29.504200 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8e528baf-a283-4092-af62-f1593beac989 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:29.504987 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8e528baf-a283-4092-af62-f1593beac989 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:29.507481 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8e528baf-a283-4092-af62-f1593beac989 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:29.796804 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-8e528baf-a283-4092-af62-f1593beac989 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:29.808810 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-8e528baf-a283-4092-af62-f1593beac989 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1521 microversion: 2.1 time: 0.333767 Jun 22 10:22:29.809406 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 132/286] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:29 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1521 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:29.919792 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-b5612fce-3e21-41d2-9233-614ff3f85296 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:29.921103 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-b5612fce-3e21-41d2-9233-614ff3f85296 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 737e0985-7e40-4d2b-ad8e-81dbf965e1e3] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:29.933766 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b5612fce-3e21-41d2-9233-614ff3f85296 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:29.940195 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b5612fce-3e21-41d2-9233-614ff3f85296 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:29.942011 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b5612fce-3e21-41d2-9233-614ff3f85296 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:29.943618 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b5612fce-3e21-41d2-9233-614ff3f85296 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:30.276789 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-b5612fce-3e21-41d2-9233-614ff3f85296 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5370eb5245247a68d7f224cdd457ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:30.290345 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-b5612fce-3e21-41d2-9233-614ff3f85296 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3" status: 200 len: 1505 microversion: 2.1 time: 0.379856 Jun 22 10:22:30.293472 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 155/287] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:29 2022] GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3 => generated 1505 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:30.825412 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-11674e97-fbea-4d6c-af3f-353db45cc274 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:30.830825 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-11674e97-fbea-4d6c-af3f-353db45cc274 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:30.842462 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-11674e97-fbea-4d6c-af3f-353db45cc274 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:30.842971 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-11674e97-fbea-4d6c-af3f-353db45cc274 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:30.843772 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-11674e97-fbea-4d6c-af3f-353db45cc274 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:30.844212 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-11674e97-fbea-4d6c-af3f-353db45cc274 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:31.122844 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-11674e97-fbea-4d6c-af3f-353db45cc274 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:31.131897 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-11674e97-fbea-4d6c-af3f-353db45cc274 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1521 microversion: 2.1 time: 0.310455 Jun 22 10:22:31.133171 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 133/288] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:30 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1521 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:31.308699 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-03fc8d99-465f-41f2-b52f-d13285f10a38 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:31.309193 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-03fc8d99-465f-41f2-b52f-d13285f10a38 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 737e0985-7e40-4d2b-ad8e-81dbf965e1e3] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:31.316205 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-03fc8d99-465f-41f2-b52f-d13285f10a38 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:31.317285 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-03fc8d99-465f-41f2-b52f-d13285f10a38 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:31.318330 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-03fc8d99-465f-41f2-b52f-d13285f10a38 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:31.319204 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-03fc8d99-465f-41f2-b52f-d13285f10a38 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:31.581347 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-03fc8d99-465f-41f2-b52f-d13285f10a38 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5370eb5245247a68d7f224cdd457ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:31.590438 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-03fc8d99-465f-41f2-b52f-d13285f10a38 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3" status: 200 len: 1505 microversion: 2.1 time: 0.285975 Jun 22 10:22:31.591758 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 156/289] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:31 2022] GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3 => generated 1505 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:31.889343 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-81ab7271-b692-4a47-9542-4fc0594ed19f tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Action: 'create', calling method: .version_select at 0x7f60da24b280>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-666635953", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOh3S8iFXUQad1vQzK9U/JQSpescy6ikbYkZhtJ1udlBYDyL0t9HZUMa1PfSULsGatUMikzeY9ax4E5NWKlufcf9a+YqqR9llbNvZwuZeEVcKXQU+e4mxNXuYCkFy1t8A=="}} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:22:31.904761 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.quota [None req-81ab7271-b692-4a47-9542-4fc0594ed19f tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Getting quotas for project a4a87feacfb84d6c9f7ea48f230753b7. Resources: {'key_pairs'} {{(pid=117679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:22:31.909288 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.quota [None req-81ab7271-b692-4a47-9542-4fc0594ed19f tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Getting quotas for user a394fc62e6a64a85b855bf2eb56b4b71 and project a4a87feacfb84d6c9f7ea48f230753b7. Resources: {'key_pairs'} {{(pid=117679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:22:31.939197 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-81ab7271-b692-4a47-9542-4fc0594ed19f tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.241591 Jun 22 10:22:31.940525 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 134/290] 10.222.0.66 () {60 vars in 1158 bytes} [Wed Jun 22 10:22:31 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:22:32.156837 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-0d303ee4-0f9d-4bb4-b069-0b2cd4b12034 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:32.157532 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-0d303ee4-0f9d-4bb4-b069-0b2cd4b12034 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:32.164653 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0d303ee4-0f9d-4bb4-b069-0b2cd4b12034 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:32.165184 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0d303ee4-0f9d-4bb4-b069-0b2cd4b12034 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:32.166051 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0d303ee4-0f9d-4bb4-b069-0b2cd4b12034 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:32.166726 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0d303ee4-0f9d-4bb4-b069-0b2cd4b12034 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:32.322388 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-0d303ee4-0f9d-4bb4-b069-0b2cd4b12034 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:32.331361 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-0d303ee4-0f9d-4bb4-b069-0b2cd4b12034 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1521 microversion: 2.1 time: 0.179672 Jun 22 10:22:32.332552 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 157/291] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:32 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:32.608668 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-69a1ce7d-7645-4e43-bf98-b018f34ee2eb tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:32.609290 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-69a1ce7d-7645-4e43-bf98-b018f34ee2eb tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 737e0985-7e40-4d2b-ad8e-81dbf965e1e3] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:32.631293 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-69a1ce7d-7645-4e43-bf98-b018f34ee2eb tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:32.631714 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-69a1ce7d-7645-4e43-bf98-b018f34ee2eb tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:32.634347 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-69a1ce7d-7645-4e43-bf98-b018f34ee2eb tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:32.634914 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-69a1ce7d-7645-4e43-bf98-b018f34ee2eb tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:32.863122 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-69a1ce7d-7645-4e43-bf98-b018f34ee2eb tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5370eb5245247a68d7f224cdd457ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:32.877373 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-69a1ce7d-7645-4e43-bf98-b018f34ee2eb tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3" status: 200 len: 1505 microversion: 2.1 time: 0.272636 Jun 22 10:22:32.888238 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 135/292] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:32 2022] GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3 => generated 1505 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:33.356450 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-efcbc305-da1e-441c-b81a-0ec749a0c862 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:33.357272 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-efcbc305-da1e-441c-b81a-0ec749a0c862 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:33.363396 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:33.368545 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-efcbc305-da1e-441c-b81a-0ec749a0c862 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:33.372796 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-efcbc305-da1e-441c-b81a-0ec749a0c862 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:33.373916 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-efcbc305-da1e-441c-b81a-0ec749a0c862 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:33.376312 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-efcbc305-da1e-441c-b81a-0ec749a0c862 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:33.556161 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-efcbc305-da1e-441c-b81a-0ec749a0c862 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:33.563919 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-efcbc305-da1e-441c-b81a-0ec749a0c862 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1521 microversion: 2.1 time: 0.218452 Jun 22 10:22:33.564575 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 158/293] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:33 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:33.895342 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-dc9a3a97-5738-45c3-94b6-f19b89feb4b4 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:33.895960 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-dc9a3a97-5738-45c3-94b6-f19b89feb4b4 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 737e0985-7e40-4d2b-ad8e-81dbf965e1e3] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:33.904009 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-dc9a3a97-5738-45c3-94b6-f19b89feb4b4 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:33.905621 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-dc9a3a97-5738-45c3-94b6-f19b89feb4b4 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:33.906471 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-dc9a3a97-5738-45c3-94b6-f19b89feb4b4 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:33.906948 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-dc9a3a97-5738-45c3-94b6-f19b89feb4b4 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:34.136915 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-dc9a3a97-5738-45c3-94b6-f19b89feb4b4 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5370eb5245247a68d7f224cdd457ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:34.147603 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-dc9a3a97-5738-45c3-94b6-f19b89feb4b4 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3" status: 200 len: 1505 microversion: 2.1 time: 0.256229 Jun 22 10:22:34.151048 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 136/294] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:33 2022] GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3 => generated 1505 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:34.581802 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-b1561e47-2461-470a-abc1-0873f77c6553 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:34.582347 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-b1561e47-2461-470a-abc1-0873f77c6553 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:34.594447 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b1561e47-2461-470a-abc1-0873f77c6553 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:34.594969 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b1561e47-2461-470a-abc1-0873f77c6553 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:34.595765 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b1561e47-2461-470a-abc1-0873f77c6553 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:34.596198 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b1561e47-2461-470a-abc1-0873f77c6553 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:34.844082 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-b1561e47-2461-470a-abc1-0873f77c6553 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:34.860341 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-b1561e47-2461-470a-abc1-0873f77c6553 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1521 microversion: 2.1 time: 0.283114 Jun 22 10:22:34.865466 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 159/295] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:34 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1521 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:35.106444 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-97eeef9b-8dc4-42b8-a096-49c80184b2ae req-4e1e56df-4fd8-46ca-82d1-79d4c55eed3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "737e0985-7e40-4d2b-ad8e-81dbf965e1e3", "name": "network-vif-deleted", "tag": "8aab1b56-8fc8-4c1b-9126-4d9686689409"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:22:35.124920 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-97eeef9b-8dc4-42b8-a096-49c80184b2ae req-4e1e56df-4fd8-46ca-82d1-79d4c55eed3a service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:35.125666 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-97eeef9b-8dc4-42b8-a096-49c80184b2ae req-4e1e56df-4fd8-46ca-82d1-79d4c55eed3a service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:35.141721 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-97eeef9b-8dc4-42b8-a096-49c80184b2ae req-4e1e56df-4fd8-46ca-82d1-79d4c55eed3a service nova] Creating event network-vif-deleted:8aab1b56-8fc8-4c1b-9126-4d9686689409 for instance 737e0985-7e40-4d2b-ad8e-81dbf965e1e3 on hv-cinder-84713 Jun 22 10:22:35.150656 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-97eeef9b-8dc4-42b8-a096-49c80184b2ae req-4e1e56df-4fd8-46ca-82d1-79d4c55eed3a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048111 Jun 22 10:22:35.155839 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 137/296] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:22:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:22:35.165571 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-e28b469e-4a56-4157-89ae-2622d4100a46 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:35.166184 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-e28b469e-4a56-4157-89ae-2622d4100a46 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 737e0985-7e40-4d2b-ad8e-81dbf965e1e3] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:35.173250 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e28b469e-4a56-4157-89ae-2622d4100a46 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:35.173692 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e28b469e-4a56-4157-89ae-2622d4100a46 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:35.175143 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e28b469e-4a56-4157-89ae-2622d4100a46 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:35.176967 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e28b469e-4a56-4157-89ae-2622d4100a46 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:35.290078 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-e28b469e-4a56-4157-89ae-2622d4100a46 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5370eb5245247a68d7f224cdd457ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:35.308918 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-e28b469e-4a56-4157-89ae-2622d4100a46 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3" status: 200 len: 1463 microversion: 2.1 time: 0.147400 Jun 22 10:22:35.311075 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 160/297] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:35 2022] GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3 => generated 1463 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:35.886847 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-255df87f-97ac-45b6-98da-b5adbd28109b tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:35.888048 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-255df87f-97ac-45b6-98da-b5adbd28109b tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:35.895683 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-255df87f-97ac-45b6-98da-b5adbd28109b tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:35.896585 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-255df87f-97ac-45b6-98da-b5adbd28109b tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:35.903168 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-255df87f-97ac-45b6-98da-b5adbd28109b tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:35.903968 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-255df87f-97ac-45b6-98da-b5adbd28109b tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:36.096790 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-255df87f-97ac-45b6-98da-b5adbd28109b tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:36.110283 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-255df87f-97ac-45b6-98da-b5adbd28109b tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1521 microversion: 2.1 time: 0.233579 Jun 22 10:22:36.119699 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 138/298] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:35 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:36.327035 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-58f986a9-b37d-4182-9f58-3b8a82bb0c5a tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:36.328582 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-58f986a9-b37d-4182-9f58-3b8a82bb0c5a tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 737e0985-7e40-4d2b-ad8e-81dbf965e1e3] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:36.336006 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-58f986a9-b37d-4182-9f58-3b8a82bb0c5a tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:36.336753 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-58f986a9-b37d-4182-9f58-3b8a82bb0c5a tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:36.337569 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-58f986a9-b37d-4182-9f58-3b8a82bb0c5a tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:36.338019 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-58f986a9-b37d-4182-9f58-3b8a82bb0c5a tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:36.372639 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-58f986a9-b37d-4182-9f58-3b8a82bb0c5a tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:36.372896 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-58f986a9-b37d-4182-9f58-3b8a82bb0c5a tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:36.373523 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.objects.instance [None req-58f986a9-b37d-4182-9f58-3b8a82bb0c5a tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lazy-loading 'fault' on Instance uuid 737e0985-7e40-4d2b-ad8e-81dbf965e1e3 {{(pid=117680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:22:36.418181 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-58f986a9-b37d-4182-9f58-3b8a82bb0c5a tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5370eb5245247a68d7f224cdd457ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:36.431462 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-58f986a9-b37d-4182-9f58-3b8a82bb0c5a tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3" status: 200 len: 1304 microversion: 2.1 time: 0.108463 Jun 22 10:22:36.431604 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 161/299] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:36 2022] GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3 => generated 1304 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:22:37.128829 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-d70f3771-ecb6-4d0a-a34b-568f5523595c tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:37.129658 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-d70f3771-ecb6-4d0a-a34b-568f5523595c tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:37.153079 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d70f3771-ecb6-4d0a-a34b-568f5523595c tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:37.153607 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d70f3771-ecb6-4d0a-a34b-568f5523595c tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:37.154641 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d70f3771-ecb6-4d0a-a34b-568f5523595c tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:37.155032 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d70f3771-ecb6-4d0a-a34b-568f5523595c tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:37.298752 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-d70f3771-ecb6-4d0a-a34b-568f5523595c tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:37.310478 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-d70f3771-ecb6-4d0a-a34b-568f5523595c tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1521 microversion: 2.1 time: 0.185987 Jun 22 10:22:37.311111 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 139/300] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:37 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:37.451401 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-b7d198d8-8ffb-4567-a835-455812277376 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:37.452076 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-b7d198d8-8ffb-4567-a835-455812277376 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 737e0985-7e40-4d2b-ad8e-81dbf965e1e3] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:37.459324 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b7d198d8-8ffb-4567-a835-455812277376 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:37.459766 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b7d198d8-8ffb-4567-a835-455812277376 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:37.460586 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b7d198d8-8ffb-4567-a835-455812277376 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:37.461014 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b7d198d8-8ffb-4567-a835-455812277376 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:37.638266 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b7d198d8-8ffb-4567-a835-455812277376 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:37.638731 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b7d198d8-8ffb-4567-a835-455812277376 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:37.639173 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.objects.instance [None req-b7d198d8-8ffb-4567-a835-455812277376 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lazy-loading 'fault' on Instance uuid 737e0985-7e40-4d2b-ad8e-81dbf965e1e3 {{(pid=117680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:22:37.682052 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-b7d198d8-8ffb-4567-a835-455812277376 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5370eb5245247a68d7f224cdd457ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:37.689922 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-b7d198d8-8ffb-4567-a835-455812277376 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3" status: 200 len: 1304 microversion: 2.1 time: 0.244802 Jun 22 10:22:37.690463 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 162/301] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:37 2022] GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3 => generated 1304 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:38.327734 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-13a754fb-79a1-4742-9f12-8aa8de195d8d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:38.328289 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-13a754fb-79a1-4742-9f12-8aa8de195d8d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:38.335165 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-13a754fb-79a1-4742-9f12-8aa8de195d8d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:38.335619 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-13a754fb-79a1-4742-9f12-8aa8de195d8d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:38.336385 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-13a754fb-79a1-4742-9f12-8aa8de195d8d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:38.336821 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-13a754fb-79a1-4742-9f12-8aa8de195d8d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:38.477825 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-13a754fb-79a1-4742-9f12-8aa8de195d8d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:38.486717 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-13a754fb-79a1-4742-9f12-8aa8de195d8d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1521 microversion: 2.1 time: 0.163022 Jun 22 10:22:38.487425 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 140/302] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:38 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:38.707243 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-745272e5-6c26-4f4c-9ec2-7f5d9c2abba3 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:38.707829 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-745272e5-6c26-4f4c-9ec2-7f5d9c2abba3 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 737e0985-7e40-4d2b-ad8e-81dbf965e1e3] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:38.714465 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-745272e5-6c26-4f4c-9ec2-7f5d9c2abba3 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:38.714948 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-745272e5-6c26-4f4c-9ec2-7f5d9c2abba3 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:38.715715 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-745272e5-6c26-4f4c-9ec2-7f5d9c2abba3 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:38.716137 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-745272e5-6c26-4f4c-9ec2-7f5d9c2abba3 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:38.747995 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-745272e5-6c26-4f4c-9ec2-7f5d9c2abba3 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:38.748433 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-745272e5-6c26-4f4c-9ec2-7f5d9c2abba3 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:38.748903 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.objects.instance [None req-745272e5-6c26-4f4c-9ec2-7f5d9c2abba3 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lazy-loading 'fault' on Instance uuid 737e0985-7e40-4d2b-ad8e-81dbf965e1e3 {{(pid=117680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:22:38.751831 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:SELECT=100 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:38.794408 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-745272e5-6c26-4f4c-9ec2-7f5d9c2abba3 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5370eb5245247a68d7f224cdd457ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:38.801942 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-745272e5-6c26-4f4c-9ec2-7f5d9c2abba3 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3" status: 200 len: 1304 microversion: 2.1 time: 0.098608 Jun 22 10:22:38.802528 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 163/303] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:38 2022] GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3 => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:39.505893 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-8326c62c-0775-44a2-b833-6daf52e36056 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:39.506513 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-8326c62c-0775-44a2-b833-6daf52e36056 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:39.513359 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8326c62c-0775-44a2-b833-6daf52e36056 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:39.513807 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8326c62c-0775-44a2-b833-6daf52e36056 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:39.514603 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8326c62c-0775-44a2-b833-6daf52e36056 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:39.515196 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8326c62c-0775-44a2-b833-6daf52e36056 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:39.660107 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-8326c62c-0775-44a2-b833-6daf52e36056 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:39.668802 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-8326c62c-0775-44a2-b833-6daf52e36056 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1521 microversion: 2.1 time: 0.166852 Jun 22 10:22:39.669381 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 141/304] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:39 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:39.821865 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-b2977375-a91e-456a-b811-4b9b548b8f40 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:39.822396 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-b2977375-a91e-456a-b811-4b9b548b8f40 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 737e0985-7e40-4d2b-ad8e-81dbf965e1e3] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:39.828744 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b2977375-a91e-456a-b811-4b9b548b8f40 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:39.829200 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b2977375-a91e-456a-b811-4b9b548b8f40 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:39.829978 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b2977375-a91e-456a-b811-4b9b548b8f40 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:39.830422 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b2977375-a91e-456a-b811-4b9b548b8f40 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:39.864645 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b2977375-a91e-456a-b811-4b9b548b8f40 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:39.865423 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b2977375-a91e-456a-b811-4b9b548b8f40 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:39.866220 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.objects.instance [None req-b2977375-a91e-456a-b811-4b9b548b8f40 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lazy-loading 'fault' on Instance uuid 737e0985-7e40-4d2b-ad8e-81dbf965e1e3 {{(pid=117680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:22:39.912026 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-b2977375-a91e-456a-b811-4b9b548b8f40 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5370eb5245247a68d7f224cdd457ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:39.919872 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-b2977375-a91e-456a-b811-4b9b548b8f40 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3" status: 200 len: 1304 microversion: 2.1 time: 0.103628 Jun 22 10:22:39.920732 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 164/305] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:39 2022] GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3 => generated 1304 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:40.685497 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-0012d4fd-7e36-48b6-a1bb-f1ef72c4d30c tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:40.686173 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-0012d4fd-7e36-48b6-a1bb-f1ef72c4d30c tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:40.693242 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0012d4fd-7e36-48b6-a1bb-f1ef72c4d30c tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:40.693724 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0012d4fd-7e36-48b6-a1bb-f1ef72c4d30c tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:40.694577 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0012d4fd-7e36-48b6-a1bb-f1ef72c4d30c tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:40.694987 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0012d4fd-7e36-48b6-a1bb-f1ef72c4d30c tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:40.829285 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-0012d4fd-7e36-48b6-a1bb-f1ef72c4d30c tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:40.837674 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-0012d4fd-7e36-48b6-a1bb-f1ef72c4d30c tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1521 microversion: 2.1 time: 0.156003 Jun 22 10:22:40.838277 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 142/306] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:40 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:40.936829 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-592b78b8-4c2d-4f82-b922-c38da1148376 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:40.937364 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-592b78b8-4c2d-4f82-b922-c38da1148376 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 737e0985-7e40-4d2b-ad8e-81dbf965e1e3] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:40.944286 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-592b78b8-4c2d-4f82-b922-c38da1148376 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:40.944708 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-592b78b8-4c2d-4f82-b922-c38da1148376 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:40.945519 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-592b78b8-4c2d-4f82-b922-c38da1148376 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:40.946489 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-592b78b8-4c2d-4f82-b922-c38da1148376 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:40.982368 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-592b78b8-4c2d-4f82-b922-c38da1148376 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:40.982852 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-592b78b8-4c2d-4f82-b922-c38da1148376 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:40.983314 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.objects.instance [None req-592b78b8-4c2d-4f82-b922-c38da1148376 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lazy-loading 'fault' on Instance uuid 737e0985-7e40-4d2b-ad8e-81dbf965e1e3 {{(pid=117680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:22:41.024682 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-592b78b8-4c2d-4f82-b922-c38da1148376 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5370eb5245247a68d7f224cdd457ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:41.032670 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-592b78b8-4c2d-4f82-b922-c38da1148376 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3" status: 200 len: 1304 microversion: 2.1 time: 0.099952 Jun 22 10:22:41.033209 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 165/307] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:40 2022] GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3 => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:41.855681 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-136b8eae-d659-465e-acf1-6d43054b50e2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:41.856344 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-136b8eae-d659-465e-acf1-6d43054b50e2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:41.863638 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-136b8eae-d659-465e-acf1-6d43054b50e2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:41.864094 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-136b8eae-d659-465e-acf1-6d43054b50e2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:41.864888 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-136b8eae-d659-465e-acf1-6d43054b50e2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:41.865319 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-136b8eae-d659-465e-acf1-6d43054b50e2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:41.916203 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_cell0:SELECT=4 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:42.007534 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-136b8eae-d659-465e-acf1-6d43054b50e2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:42.015224 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-136b8eae-d659-465e-acf1-6d43054b50e2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1521 microversion: 2.1 time: 0.164322 Jun 22 10:22:42.015781 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 143/308] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:41 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:42.059719 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-6867fc2c-a1bb-41d2-9261-bb2c8452ded9 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:42.060314 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-6867fc2c-a1bb-41d2-9261-bb2c8452ded9 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 737e0985-7e40-4d2b-ad8e-81dbf965e1e3] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:42.068868 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6867fc2c-a1bb-41d2-9261-bb2c8452ded9 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:42.069605 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6867fc2c-a1bb-41d2-9261-bb2c8452ded9 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:42.070954 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6867fc2c-a1bb-41d2-9261-bb2c8452ded9 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:42.071616 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6867fc2c-a1bb-41d2-9261-bb2c8452ded9 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:42.105289 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6867fc2c-a1bb-41d2-9261-bb2c8452ded9 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:42.105732 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6867fc2c-a1bb-41d2-9261-bb2c8452ded9 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:42.106185 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.objects.instance [None req-6867fc2c-a1bb-41d2-9261-bb2c8452ded9 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lazy-loading 'fault' on Instance uuid 737e0985-7e40-4d2b-ad8e-81dbf965e1e3 {{(pid=117680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:22:42.149334 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-6867fc2c-a1bb-41d2-9261-bb2c8452ded9 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5370eb5245247a68d7f224cdd457ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:42.157840 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-6867fc2c-a1bb-41d2-9261-bb2c8452ded9 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3" status: 200 len: 1304 microversion: 2.1 time: 0.102122 Jun 22 10:22:42.158412 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 166/309] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:42 2022] GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3 => generated 1304 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:43.035528 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-791f8de9-f998-44fe-9540-ff8f6ee1b0c8 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:43.036387 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-791f8de9-f998-44fe-9540-ff8f6ee1b0c8 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:43.044619 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-791f8de9-f998-44fe-9540-ff8f6ee1b0c8 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:43.045046 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-791f8de9-f998-44fe-9540-ff8f6ee1b0c8 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:43.045835 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-791f8de9-f998-44fe-9540-ff8f6ee1b0c8 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:43.046264 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-791f8de9-f998-44fe-9540-ff8f6ee1b0c8 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:43.175648 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-680f4e3e-d278-4a3a-b452-8dab55db0d77 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:43.176231 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-680f4e3e-d278-4a3a-b452-8dab55db0d77 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 737e0985-7e40-4d2b-ad8e-81dbf965e1e3] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:43.182877 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-680f4e3e-d278-4a3a-b452-8dab55db0d77 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:43.183304 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-680f4e3e-d278-4a3a-b452-8dab55db0d77 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:43.184113 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-680f4e3e-d278-4a3a-b452-8dab55db0d77 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:43.184542 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-680f4e3e-d278-4a3a-b452-8dab55db0d77 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:43.194205 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-791f8de9-f998-44fe-9540-ff8f6ee1b0c8 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:43.202743 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-791f8de9-f998-44fe-9540-ff8f6ee1b0c8 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1521 microversion: 2.1 time: 0.173770 Jun 22 10:22:43.203378 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 144/310] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:43 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:43.216424 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-680f4e3e-d278-4a3a-b452-8dab55db0d77 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:43.216892 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-680f4e3e-d278-4a3a-b452-8dab55db0d77 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:43.217366 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.objects.instance [None req-680f4e3e-d278-4a3a-b452-8dab55db0d77 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lazy-loading 'fault' on Instance uuid 737e0985-7e40-4d2b-ad8e-81dbf965e1e3 {{(pid=117680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:22:43.508286 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-680f4e3e-d278-4a3a-b452-8dab55db0d77 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5370eb5245247a68d7f224cdd457ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:43.516281 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-680f4e3e-d278-4a3a-b452-8dab55db0d77 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3" status: 200 len: 1304 microversion: 2.1 time: 0.344497 Jun 22 10:22:43.516784 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 167/311] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:43 2022] GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3 => generated 1304 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:44.220293 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-12c79454-31a9-4c60-90c7-933a2a8a9a0e tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:44.220889 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-12c79454-31a9-4c60-90c7-933a2a8a9a0e tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:44.228558 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-12c79454-31a9-4c60-90c7-933a2a8a9a0e tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:44.229000 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-12c79454-31a9-4c60-90c7-933a2a8a9a0e tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:44.229791 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-12c79454-31a9-4c60-90c7-933a2a8a9a0e tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:44.230225 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-12c79454-31a9-4c60-90c7-933a2a8a9a0e tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:44.371358 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-12c79454-31a9-4c60-90c7-933a2a8a9a0e tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:44.378988 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-12c79454-31a9-4c60-90c7-933a2a8a9a0e tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1521 microversion: 2.1 time: 0.162964 Jun 22 10:22:44.379587 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 145/312] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:44 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:44.534039 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-30e97775-0e46-4f43-849e-467f86ce8a1e tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:44.534848 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-30e97775-0e46-4f43-849e-467f86ce8a1e tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 737e0985-7e40-4d2b-ad8e-81dbf965e1e3] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:44.541503 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-30e97775-0e46-4f43-849e-467f86ce8a1e tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:44.541968 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-30e97775-0e46-4f43-849e-467f86ce8a1e tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:44.542860 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-30e97775-0e46-4f43-849e-467f86ce8a1e tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:44.543321 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-30e97775-0e46-4f43-849e-467f86ce8a1e tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:44.577618 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-30e97775-0e46-4f43-849e-467f86ce8a1e tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:44.577968 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-30e97775-0e46-4f43-849e-467f86ce8a1e tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:44.578420 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.objects.instance [None req-30e97775-0e46-4f43-849e-467f86ce8a1e tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lazy-loading 'fault' on Instance uuid 737e0985-7e40-4d2b-ad8e-81dbf965e1e3 {{(pid=117680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:22:44.623986 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-30e97775-0e46-4f43-849e-467f86ce8a1e tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5370eb5245247a68d7f224cdd457ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:44.634888 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-30e97775-0e46-4f43-849e-467f86ce8a1e tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3" status: 200 len: 1304 microversion: 2.1 time: 0.105308 Jun 22 10:22:44.635454 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 168/313] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:44 2022] GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3 => generated 1304 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:45.397312 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-4d6be356-9583-4312-b3b7-d48ed6e7e780 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:45.398936 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-4d6be356-9583-4312-b3b7-d48ed6e7e780 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:45.406691 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4d6be356-9583-4312-b3b7-d48ed6e7e780 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:45.407278 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4d6be356-9583-4312-b3b7-d48ed6e7e780 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:45.408307 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4d6be356-9583-4312-b3b7-d48ed6e7e780 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:45.408785 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4d6be356-9583-4312-b3b7-d48ed6e7e780 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:45.630537 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-4d6be356-9583-4312-b3b7-d48ed6e7e780 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:45.639239 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-4d6be356-9583-4312-b3b7-d48ed6e7e780 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1521 microversion: 2.1 time: 0.246387 Jun 22 10:22:45.639868 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 146/314] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:45 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:45.654543 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-14896ff3-5b96-4cf3-8427-11ca39cdd0c9 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:45.655647 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-14896ff3-5b96-4cf3-8427-11ca39cdd0c9 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 737e0985-7e40-4d2b-ad8e-81dbf965e1e3] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:45.661932 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-14896ff3-5b96-4cf3-8427-11ca39cdd0c9 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:45.662385 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-14896ff3-5b96-4cf3-8427-11ca39cdd0c9 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:45.663191 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-14896ff3-5b96-4cf3-8427-11ca39cdd0c9 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:45.663632 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-14896ff3-5b96-4cf3-8427-11ca39cdd0c9 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:45.679035 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.wsgi [None req-14896ff3-5b96-4cf3-8427-11ca39cdd0c9 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] HTTP exception thrown: Instance 737e0985-7e40-4d2b-ad8e-81dbf965e1e3 could not be found. Jun 22 10:22:45.681072 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-14896ff3-5b96-4cf3-8427-11ca39cdd0c9 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Request method failure captured: Jun 22 10:22:45.681072 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: request: GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3 HTTP/1.1 Jun 22 10:22:45.681072 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Accept: application/json Jun 22 10:22:45.681072 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Accept-Encoding: identity Jun 22 10:22:45.681072 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Connection: close Jun 22 10:22:45.681072 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Content-Length: 0 Jun 22 10:22:45.681072 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Content-Type: application/json Jun 22 10:22:45.681072 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Host: 10.222.0.66 Jun 22 10:22:45.681072 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Openstack-System-Scope: None Jun 22 10:22:45.681072 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: User-Agent: python-urllib3/1.26.9 Jun 22 10:22:45.681072 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Auth-Token: gAAAAABisu09ieeH2j3WICx8k1FgCC0aOp7L5bFQjtKIU620ed1N1owh0uQJRcnk59sS3Y71tMbY0hQlAOwK5Wgeuc-mBxM5JmSvYpq89jhW7U3VRrChGmdkRfmxLFdKo0tnJwIW60b3uC0mWOGDRPbHE06IR1Sl1P6kXpgqx7cPqIFOScQudTE Jun 22 10:22:45.681072 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Domain-Id: None Jun 22 10:22:45.681072 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Domain-Name: None Jun 22 10:22:45.681072 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Identity-Status: Confirmed Jun 22 10:22:45.681072 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Is-Admin-Project: True Jun 22 10:22:45.681072 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Domain-Id: default Jun 22 10:22:45.681072 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Domain-Name: Default Jun 22 10:22:45.681072 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Id: c5370eb5245247a68d7f224cdd457ea1 Jun 22 10:22:45.681072 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Name: tempest-VolumesActionsTest-298856248 Jun 22 10:22:45.681072 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Role: member,reader Jun 22 10:22:45.681072 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Roles: member,reader Jun 22 10:22:45.682452 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_c5370eb5245247a68d7f224cdd457ea1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c5370eb5245247a68d7f224cdd457ea1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/c5370eb5245247a68d7f224cdd457ea1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c5370eb5245247a68d7f224cdd457ea1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}] Jun 22 10:22:45.682452 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant: tempest-VolumesActionsTest-298856248 Jun 22 10:22:45.682452 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant-Id: c5370eb5245247a68d7f224cdd457ea1 Jun 22 10:22:45.682452 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant-Name: tempest-VolumesActionsTest-298856248 Jun 22 10:22:45.682452 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User: tempest-VolumesActionsTest-298856248-project Jun 22 10:22:45.682452 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Domain-Id: default Jun 22 10:22:45.682452 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Domain-Name: Default Jun 22 10:22:45.682452 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Id: 0d1dcf4b8dbb4e1698e7b0c4dc9c63a4 Jun 22 10:22:45.682452 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Name: tempest-VolumesActionsTest-298856248-project Jun 22 10:22:45.682452 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: method: > Jun 22 10:22:45.682452 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: exception: Instance 737e0985-7e40-4d2b-ad8e-81dbf965e1e3 could not be found. Jun 22 10:22:45.682452 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: action_args: {'id': '737e0985-7e40-4d2b-ad8e-81dbf965e1e3'} Jun 22 10:22:45.683285 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:22:45.683285 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:45.683285 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:22:45.683285 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:22:45.683285 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:22:45.683285 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:22:45.683285 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:22:45.683285 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:22:45.683285 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:22:45.683285 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:22:45.683285 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 737e0985-7e40-4d2b-ad8e-81dbf965e1e3 could not be found. Jun 22 10:22:45.683285 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:22:45.683285 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:22:45.683285 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:22:45.683285 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:45.683285 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:22:45.683285 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:22:45.683285 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:22:45.683285 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:22:45.683285 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:22:45.684489 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:22:45.684489 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:22:45.684489 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:22:45.684489 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:22:45.684489 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:22:45.684489 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:22:45.684489 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:22:45.684489 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 737e0985-7e40-4d2b-ad8e-81dbf965e1e3 could not be found. Jun 22 10:22:45.684489 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:22:45.684489 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:22:45.684489 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:22:45.684489 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:22:45.684489 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:22:45.684489 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:22:45.684489 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:22:45.684489 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:22:45.684489 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 737e0985-7e40-4d2b-ad8e-81dbf965e1e3 could not be found. Jun 22 10:22:45.684489 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:22:45.686935 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-14896ff3-5b96-4cf3-8427-11ca39cdd0c9 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Returning 404 to user: Instance 737e0985-7e40-4d2b-ad8e-81dbf965e1e3 could not be found. {{(pid=117680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:22:45.686935 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-14896ff3-5b96-4cf3-8427-11ca39cdd0c9 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3" status: 404 len: 111 microversion: 2.1 time: 0.035176 Jun 22 10:22:45.686935 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 169/315] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:45 2022] GET /compute/v2.1/servers/737e0985-7e40-4d2b-ad8e-81dbf965e1e3 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:22:45.797848 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-3fb3a423-e4b3-4f97-a8bf-f45d8d26606f tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1402180351", "imageRef": "58addf50-5317-403a-beb0-4760bdbcaa13", "flavorRef": "452", "networks": [{"uuid": "44cd5c0c-cb86-4f23-8ca9-182c70ed950d"}]}} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:22:45.848778 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.network.neutron [None req-3fb3a423-e4b3-4f97-a8bf-f45d8d26606f tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] validate_networks() for [('44cd5c0c-cb86-4f23-8ca9-182c70ed950d', None, None, None, None, None)] {{(pid=117679) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 10:22:46.340492 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-3fb3a423-e4b3-4f97-a8bf-f45d8d26606f tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Flavor limits 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 10:22:46.340914 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-3fb3a423-e4b3-4f97-a8bf-f45d8d26606f tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Image limits 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 10:22:46.341386 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-3fb3a423-e4b3-4f97-a8bf-f45d8d26606f tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Flavor pref 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 10:22:46.341888 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-3fb3a423-e4b3-4f97-a8bf-f45d8d26606f tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Image pref 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 10:22:46.342249 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-3fb3a423-e4b3-4f97-a8bf-f45d8d26606f tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 10:22:46.353118 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3fb3a423-e4b3-4f97-a8bf-f45d8d26606f tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:46.353565 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3fb3a423-e4b3-4f97-a8bf-f45d8d26606f tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:46.354348 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3fb3a423-e4b3-4f97-a8bf-f45d8d26606f tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:46.354813 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3fb3a423-e4b3-4f97-a8bf-f45d8d26606f tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:46.375213 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.quota [None req-3fb3a423-e4b3-4f97-a8bf-f45d8d26606f tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Getting quotas for project c5370eb5245247a68d7f224cdd457ea1. Resources: {'instances', 'cores', 'ram'} {{(pid=117679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:22:46.380381 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.quota [None req-3fb3a423-e4b3-4f97-a8bf-f45d8d26606f tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Getting quotas for user 0d1dcf4b8dbb4e1698e7b0c4dc9c63a4 and project c5370eb5245247a68d7f224cdd457ea1. Resources: {'instances', 'cores', 'ram'} {{(pid=117679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:22:46.393689 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-3fb3a423-e4b3-4f97-a8bf-f45d8d26606f tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Going to run 1 instances... {{(pid=117679) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 10:22:46.396011 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-3fb3a423-e4b3-4f97-a8bf-f45d8d26606f tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 1236b62e-0b77-4a1e-8e13-86eb3aa55773] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58addf50-5317-403a-beb0-4760bdbcaa13',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 10:22:46.454151 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-3fb3a423-e4b3-4f97-a8bf-f45d8d26606f tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.660395 Jun 22 10:22:46.456028 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 147/316] 10.222.0.66 () {60 vars in 1146 bytes} [Wed Jun 22 10:22:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 10:22:46.473461 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-dc39ccaf-173b-4816-bb11-46c1f7388307 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:46.474752 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-dc39ccaf-173b-4816-bb11-46c1f7388307 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 1236b62e-0b77-4a1e-8e13-86eb3aa55773] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:46.581038 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-dc39ccaf-173b-4816-bb11-46c1f7388307 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5370eb5245247a68d7f224cdd457ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:46.589052 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-dc39ccaf-173b-4816-bb11-46c1f7388307 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "GET /compute/v2.1/servers/1236b62e-0b77-4a1e-8e13-86eb3aa55773" status: 200 len: 1214 microversion: 2.1 time: 0.126131 Jun 22 10:22:46.589900 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 170/317] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:46 2022] GET /compute/v2.1/servers/1236b62e-0b77-4a1e-8e13-86eb3aa55773 => generated 1214 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:46.657216 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-bfe57458-715b-473a-9070-0031570b6648 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:46.657833 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-bfe57458-715b-473a-9070-0031570b6648 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:46.665192 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-bfe57458-715b-473a-9070-0031570b6648 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:46.665625 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-bfe57458-715b-473a-9070-0031570b6648 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:46.666395 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-bfe57458-715b-473a-9070-0031570b6648 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:46.666963 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-bfe57458-715b-473a-9070-0031570b6648 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:46.819266 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-bfe57458-715b-473a-9070-0031570b6648 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:46.826864 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-bfe57458-715b-473a-9070-0031570b6648 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1521 microversion: 2.1 time: 0.173814 Jun 22 10:22:46.827448 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 148/318] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:46 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:47.609760 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-129ff736-13e8-4ba0-8f20-d622d845acef tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:47.610387 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-129ff736-13e8-4ba0-8f20-d622d845acef tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 1236b62e-0b77-4a1e-8e13-86eb3aa55773] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:47.616957 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-129ff736-13e8-4ba0-8f20-d622d845acef tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:47.617401 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-129ff736-13e8-4ba0-8f20-d622d845acef tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:47.618170 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-129ff736-13e8-4ba0-8f20-d622d845acef tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:47.618633 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-129ff736-13e8-4ba0-8f20-d622d845acef tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:47.686538 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-129ff736-13e8-4ba0-8f20-d622d845acef tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5370eb5245247a68d7f224cdd457ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:47.695754 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-129ff736-13e8-4ba0-8f20-d622d845acef tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "GET /compute/v2.1/servers/1236b62e-0b77-4a1e-8e13-86eb3aa55773" status: 200 len: 1210 microversion: 2.1 time: 0.089997 Jun 22 10:22:47.696485 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 171/319] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:47 2022] GET /compute/v2.1/servers/1236b62e-0b77-4a1e-8e13-86eb3aa55773 => generated 1210 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:47.846632 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-9eec3e90-b24a-4ca8-9933-691d86b17aec tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:47.847183 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-9eec3e90-b24a-4ca8-9933-691d86b17aec tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:47.854384 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9eec3e90-b24a-4ca8-9933-691d86b17aec tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:47.854860 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9eec3e90-b24a-4ca8-9933-691d86b17aec tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:47.855608 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9eec3e90-b24a-4ca8-9933-691d86b17aec tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:47.856079 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9eec3e90-b24a-4ca8-9933-691d86b17aec tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:47.995522 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-9eec3e90-b24a-4ca8-9933-691d86b17aec tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:47.997746 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:48.004945 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-9eec3e90-b24a-4ca8-9933-691d86b17aec tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1521 microversion: 2.1 time: 0.162319 Jun 22 10:22:48.005511 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 149/320] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:47 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:48.713504 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-803ecfac-6007-4e81-9b86-56063c39a600 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:48.714104 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-803ecfac-6007-4e81-9b86-56063c39a600 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 1236b62e-0b77-4a1e-8e13-86eb3aa55773] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:48.720501 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-803ecfac-6007-4e81-9b86-56063c39a600 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:48.720952 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-803ecfac-6007-4e81-9b86-56063c39a600 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:48.721732 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-803ecfac-6007-4e81-9b86-56063c39a600 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:48.722157 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-803ecfac-6007-4e81-9b86-56063c39a600 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:48.788600 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-803ecfac-6007-4e81-9b86-56063c39a600 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5370eb5245247a68d7f224cdd457ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:48.799895 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-803ecfac-6007-4e81-9b86-56063c39a600 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "GET /compute/v2.1/servers/1236b62e-0b77-4a1e-8e13-86eb3aa55773" status: 200 len: 1210 microversion: 2.1 time: 0.090247 Jun 22 10:22:48.800652 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 172/321] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:48 2022] GET /compute/v2.1/servers/1236b62e-0b77-4a1e-8e13-86eb3aa55773 => generated 1210 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:49.021686 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-33275858-48db-4df3-87cd-9a7e34732d7b tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:49.022319 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-33275858-48db-4df3-87cd-9a7e34732d7b tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:49.029769 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-33275858-48db-4df3-87cd-9a7e34732d7b tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:49.030605 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-33275858-48db-4df3-87cd-9a7e34732d7b tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:49.031395 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-33275858-48db-4df3-87cd-9a7e34732d7b tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:49.031835 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-33275858-48db-4df3-87cd-9a7e34732d7b tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:49.168555 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-33275858-48db-4df3-87cd-9a7e34732d7b tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:49.177664 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-33275858-48db-4df3-87cd-9a7e34732d7b tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1521 microversion: 2.1 time: 0.159939 Jun 22 10:22:49.178245 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 150/322] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:49 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:49.818385 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-a467bea5-4e44-4d68-8dc6-eab02b48d7c3 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:49.819031 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-a467bea5-4e44-4d68-8dc6-eab02b48d7c3 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 1236b62e-0b77-4a1e-8e13-86eb3aa55773] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:49.825352 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a467bea5-4e44-4d68-8dc6-eab02b48d7c3 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:49.825799 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a467bea5-4e44-4d68-8dc6-eab02b48d7c3 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:49.826602 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a467bea5-4e44-4d68-8dc6-eab02b48d7c3 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:49.827020 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a467bea5-4e44-4d68-8dc6-eab02b48d7c3 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:49.889656 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-a467bea5-4e44-4d68-8dc6-eab02b48d7c3 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5370eb5245247a68d7f224cdd457ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:49.897800 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-a467bea5-4e44-4d68-8dc6-eab02b48d7c3 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "GET /compute/v2.1/servers/1236b62e-0b77-4a1e-8e13-86eb3aa55773" status: 200 len: 1210 microversion: 2.1 time: 0.083297 Jun 22 10:22:49.898383 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 173/323] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:49 2022] GET /compute/v2.1/servers/1236b62e-0b77-4a1e-8e13-86eb3aa55773 => generated 1210 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:50.196571 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-ae128259-8192-4f75-9694-8d74c9f6f0a7 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:50.197108 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-ae128259-8192-4f75-9694-8d74c9f6f0a7 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:50.203990 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ae128259-8192-4f75-9694-8d74c9f6f0a7 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:50.204427 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ae128259-8192-4f75-9694-8d74c9f6f0a7 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:50.205189 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ae128259-8192-4f75-9694-8d74c9f6f0a7 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:50.205619 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ae128259-8192-4f75-9694-8d74c9f6f0a7 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:50.338482 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-ae128259-8192-4f75-9694-8d74c9f6f0a7 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:50.346250 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-ae128259-8192-4f75-9694-8d74c9f6f0a7 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1521 microversion: 2.1 time: 0.155395 Jun 22 10:22:50.346932 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 151/324] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:50 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:50.915619 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-0f143f5c-4578-420d-b150-75b93a92f3c4 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:50.916271 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-0f143f5c-4578-420d-b150-75b93a92f3c4 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 1236b62e-0b77-4a1e-8e13-86eb3aa55773] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:50.923666 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0f143f5c-4578-420d-b150-75b93a92f3c4 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:50.924093 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0f143f5c-4578-420d-b150-75b93a92f3c4 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:50.924924 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0f143f5c-4578-420d-b150-75b93a92f3c4 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:50.925353 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0f143f5c-4578-420d-b150-75b93a92f3c4 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:50.988683 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-0f143f5c-4578-420d-b150-75b93a92f3c4 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5370eb5245247a68d7f224cdd457ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:50.996925 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-0f143f5c-4578-420d-b150-75b93a92f3c4 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "GET /compute/v2.1/servers/1236b62e-0b77-4a1e-8e13-86eb3aa55773" status: 200 len: 1210 microversion: 2.1 time: 0.085474 Jun 22 10:22:50.997506 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 174/325] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:50 2022] GET /compute/v2.1/servers/1236b62e-0b77-4a1e-8e13-86eb3aa55773 => generated 1210 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:51.363610 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-65a1bb2d-5cfe-4689-995e-50fa5e64b276 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:51.364258 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-65a1bb2d-5cfe-4689-995e-50fa5e64b276 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:51.371384 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-65a1bb2d-5cfe-4689-995e-50fa5e64b276 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:51.371851 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-65a1bb2d-5cfe-4689-995e-50fa5e64b276 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:51.372620 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-65a1bb2d-5cfe-4689-995e-50fa5e64b276 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:51.373046 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-65a1bb2d-5cfe-4689-995e-50fa5e64b276 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:51.509311 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-65a1bb2d-5cfe-4689-995e-50fa5e64b276 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:51.517356 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-65a1bb2d-5cfe-4689-995e-50fa5e64b276 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1521 microversion: 2.1 time: 0.157616 Jun 22 10:22:51.517926 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 152/326] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:51 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:52.014413 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-af9af307-59cc-4935-94fb-9a811c6829aa tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:52.015032 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-af9af307-59cc-4935-94fb-9a811c6829aa tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 1236b62e-0b77-4a1e-8e13-86eb3aa55773] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:52.021774 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-af9af307-59cc-4935-94fb-9a811c6829aa tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:52.022232 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-af9af307-59cc-4935-94fb-9a811c6829aa tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:52.023068 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-af9af307-59cc-4935-94fb-9a811c6829aa tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:52.023509 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-af9af307-59cc-4935-94fb-9a811c6829aa tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:52.093777 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-af9af307-59cc-4935-94fb-9a811c6829aa tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5370eb5245247a68d7f224cdd457ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:52.102126 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-af9af307-59cc-4935-94fb-9a811c6829aa tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "GET /compute/v2.1/servers/1236b62e-0b77-4a1e-8e13-86eb3aa55773" status: 200 len: 1210 microversion: 2.1 time: 0.091675 Jun 22 10:22:52.102736 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 175/327] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:52 2022] GET /compute/v2.1/servers/1236b62e-0b77-4a1e-8e13-86eb3aa55773 => generated 1210 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:52.535654 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-c4139426-3295-474f-bf7e-06bcc7f3a503 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:52.536267 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-c4139426-3295-474f-bf7e-06bcc7f3a503 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:52.543581 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c4139426-3295-474f-bf7e-06bcc7f3a503 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:52.544126 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c4139426-3295-474f-bf7e-06bcc7f3a503 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:52.545176 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c4139426-3295-474f-bf7e-06bcc7f3a503 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:52.545750 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c4139426-3295-474f-bf7e-06bcc7f3a503 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:52.692701 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-c4139426-3295-474f-bf7e-06bcc7f3a503 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:52.701099 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-c4139426-3295-474f-bf7e-06bcc7f3a503 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1521 microversion: 2.1 time: 0.169753 Jun 22 10:22:52.701680 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 153/328] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:52 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:53.119474 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-f971833f-5db2-4694-8a1e-903ecc7fbeb5 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:53.120080 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-f971833f-5db2-4694-8a1e-903ecc7fbeb5 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 1236b62e-0b77-4a1e-8e13-86eb3aa55773] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:53.126644 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f971833f-5db2-4694-8a1e-903ecc7fbeb5 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:53.127096 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f971833f-5db2-4694-8a1e-903ecc7fbeb5 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:53.127862 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f971833f-5db2-4694-8a1e-903ecc7fbeb5 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:53.128287 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f971833f-5db2-4694-8a1e-903ecc7fbeb5 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:53.196344 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-f971833f-5db2-4694-8a1e-903ecc7fbeb5 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5370eb5245247a68d7f224cdd457ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:53.206639 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-f971833f-5db2-4694-8a1e-903ecc7fbeb5 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "GET /compute/v2.1/servers/1236b62e-0b77-4a1e-8e13-86eb3aa55773" status: 200 len: 1266 microversion: 2.1 time: 0.091146 Jun 22 10:22:53.207233 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 176/329] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:53 2022] GET /compute/v2.1/servers/1236b62e-0b77-4a1e-8e13-86eb3aa55773 => generated 1266 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:53.717990 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-47116b6c-cc36-421f-ab58-33ce12b24cc6 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:53.718749 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-47116b6c-cc36-421f-ab58-33ce12b24cc6 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:53.726237 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-47116b6c-cc36-421f-ab58-33ce12b24cc6 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:53.726713 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-47116b6c-cc36-421f-ab58-33ce12b24cc6 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:53.727505 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-47116b6c-cc36-421f-ab58-33ce12b24cc6 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:53.727942 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-47116b6c-cc36-421f-ab58-33ce12b24cc6 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:53.985066 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-47116b6c-cc36-421f-ab58-33ce12b24cc6 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:53.994108 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-47116b6c-cc36-421f-ab58-33ce12b24cc6 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1501 microversion: 2.1 time: 0.280398 Jun 22 10:22:53.994943 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 154/330] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:53 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1501 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:54.010079 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-ccecddd5-878e-439c-a239-4809ed6cee56 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:54.010822 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-ccecddd5-878e-439c-a239-4809ed6cee56 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 739e9dbf-4ccc-4022-83e4-d2f4c36955ee] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:54.018785 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ccecddd5-878e-439c-a239-4809ed6cee56 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:54.019231 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ccecddd5-878e-439c-a239-4809ed6cee56 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:54.020012 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ccecddd5-878e-439c-a239-4809ed6cee56 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:54.020449 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ccecddd5-878e-439c-a239-4809ed6cee56 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:54.224659 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-1ac02fca-c72c-4277-a7a8-284c3f0d8dc7 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:54.225285 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-1ac02fca-c72c-4277-a7a8-284c3f0d8dc7 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 1236b62e-0b77-4a1e-8e13-86eb3aa55773] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:54.231675 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1ac02fca-c72c-4277-a7a8-284c3f0d8dc7 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:54.232122 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1ac02fca-c72c-4277-a7a8-284c3f0d8dc7 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:54.232929 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1ac02fca-c72c-4277-a7a8-284c3f0d8dc7 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:54.233365 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1ac02fca-c72c-4277-a7a8-284c3f0d8dc7 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:54.262355 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-ccecddd5-878e-439c-a239-4809ed6cee56 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:54.272012 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-ccecddd5-878e-439c-a239-4809ed6cee56 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee" status: 200 len: 1516 microversion: 2.1 time: 0.265819 Jun 22 10:22:54.272602 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 177/331] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:54 2022] GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee => generated 1516 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:54.316647 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-1ac02fca-c72c-4277-a7a8-284c3f0d8dc7 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5370eb5245247a68d7f224cdd457ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:54.334083 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-1ac02fca-c72c-4277-a7a8-284c3f0d8dc7 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "GET /compute/v2.1/servers/1236b62e-0b77-4a1e-8e13-86eb3aa55773" status: 200 len: 1272 microversion: 2.1 time: 0.113160 Jun 22 10:22:54.335720 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 155/332] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:54 2022] GET /compute/v2.1/servers/1236b62e-0b77-4a1e-8e13-86eb3aa55773 => generated 1272 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:55.250616 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-4ed0d4a1-d54c-4d60-86d0-a490d6d09790 req-79ef8817-34df-40b9-984d-e368c42dc4f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1236b62e-0b77-4a1e-8e13-86eb3aa55773", "tag": "2c070c8b-8bd7-48f9-bfcd-16e7e0242446"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:22:55.274450 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-4ed0d4a1-d54c-4d60-86d0-a490d6d09790 req-79ef8817-34df-40b9-984d-e368c42dc4f0 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:55.275100 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-4ed0d4a1-d54c-4d60-86d0-a490d6d09790 req-79ef8817-34df-40b9-984d-e368c42dc4f0 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:55.291568 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-4ed0d4a1-d54c-4d60-86d0-a490d6d09790 req-79ef8817-34df-40b9-984d-e368c42dc4f0 service nova] Creating event network-changed:2c070c8b-8bd7-48f9-bfcd-16e7e0242446 for instance 1236b62e-0b77-4a1e-8e13-86eb3aa55773 on hv-cinder-84713 Jun 22 10:22:55.297856 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-4ed0d4a1-d54c-4d60-86d0-a490d6d09790 req-79ef8817-34df-40b9-984d-e368c42dc4f0 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051275 Jun 22 10:22:55.298463 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 178/333] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:22:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:22:55.359841 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-7e56a48d-b9ab-401a-8334-cc54a29ded89 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:55.360440 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-7e56a48d-b9ab-401a-8334-cc54a29ded89 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 1236b62e-0b77-4a1e-8e13-86eb3aa55773] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:55.367947 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7e56a48d-b9ab-401a-8334-cc54a29ded89 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:55.368403 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7e56a48d-b9ab-401a-8334-cc54a29ded89 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:55.369195 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7e56a48d-b9ab-401a-8334-cc54a29ded89 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:55.369946 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7e56a48d-b9ab-401a-8334-cc54a29ded89 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:55.616273 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-7e56a48d-b9ab-401a-8334-cc54a29ded89 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5370eb5245247a68d7f224cdd457ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:55.626280 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-7e56a48d-b9ab-401a-8334-cc54a29ded89 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "GET /compute/v2.1/servers/1236b62e-0b77-4a1e-8e13-86eb3aa55773" status: 200 len: 1314 microversion: 2.1 time: 0.270278 Jun 22 10:22:55.636325 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 156/334] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:55 2022] GET /compute/v2.1/servers/1236b62e-0b77-4a1e-8e13-86eb3aa55773 => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:55.679544 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-9181eb8d-7b3b-4e97-b9ec-235d963e8de4 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:22:55.680642 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-9181eb8d-7b3b-4e97-b9ec-235d963e8de4 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 739e9dbf-4ccc-4022-83e4-d2f4c36955ee] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:55.687344 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9181eb8d-7b3b-4e97-b9ec-235d963e8de4 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:55.688029 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9181eb8d-7b3b-4e97-b9ec-235d963e8de4 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:55.688927 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9181eb8d-7b3b-4e97-b9ec-235d963e8de4 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:55.689254 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9181eb8d-7b3b-4e97-b9ec-235d963e8de4 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:55.713593 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.objects.instance [None req-9181eb8d-7b3b-4e97-b9ec-235d963e8de4 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lazy-loading 'flavor' on Instance uuid 739e9dbf-4ccc-4022-83e4-d2f4c36955ee {{(pid=117680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:22:55.785674 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:55.829025 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-9181eb8d-7b3b-4e97-b9ec-235d963e8de4 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "POST /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee/action" status: 200 len: 32 microversion: 2.1 time: 0.154342 Jun 22 10:22:55.829646 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 179/335] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Jun 22 10:22:55 2022] POST /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee/action => generated 32 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 22 10:22:55.839468 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-4aee1c0b-1285-443d-a5c9-bf0b6cd08158 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:55.840117 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-4aee1c0b-1285-443d-a5c9-bf0b6cd08158 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 739e9dbf-4ccc-4022-83e4-d2f4c36955ee] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:55.848634 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4aee1c0b-1285-443d-a5c9-bf0b6cd08158 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:55.849086 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4aee1c0b-1285-443d-a5c9-bf0b6cd08158 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:55.852217 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4aee1c0b-1285-443d-a5c9-bf0b6cd08158 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:55.852653 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4aee1c0b-1285-443d-a5c9-bf0b6cd08158 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:55.991407 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-4aee1c0b-1285-443d-a5c9-bf0b6cd08158 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:55.999477 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-4aee1c0b-1285-443d-a5c9-bf0b6cd08158 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee" status: 200 len: 1522 microversion: 2.1 time: 0.164289 Jun 22 10:22:56.000062 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 157/336] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:55 2022] GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:56.641054 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell0:SELECT=2 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:56.646195 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-0fb512fe-92b0-4aa5-a6e3-6322f55fea14 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:56.646986 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-0fb512fe-92b0-4aa5-a6e3-6322f55fea14 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 1236b62e-0b77-4a1e-8e13-86eb3aa55773] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:56.653978 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0fb512fe-92b0-4aa5-a6e3-6322f55fea14 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:56.654417 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0fb512fe-92b0-4aa5-a6e3-6322f55fea14 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:56.654417 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0fb512fe-92b0-4aa5-a6e3-6322f55fea14 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:56.656026 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0fb512fe-92b0-4aa5-a6e3-6322f55fea14 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:56.801987 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-0fb512fe-92b0-4aa5-a6e3-6322f55fea14 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5370eb5245247a68d7f224cdd457ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:56.810331 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-0fb512fe-92b0-4aa5-a6e3-6322f55fea14 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "GET /compute/v2.1/servers/1236b62e-0b77-4a1e-8e13-86eb3aa55773" status: 200 len: 1314 microversion: 2.1 time: 0.170178 Jun 22 10:22:56.811015 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 180/337] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:56 2022] GET /compute/v2.1/servers/1236b62e-0b77-4a1e-8e13-86eb3aa55773 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:57.017231 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-5ab1b067-0423-4264-a6b6-fa70b0f34bee tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:57.017911 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-5ab1b067-0423-4264-a6b6-fa70b0f34bee tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 739e9dbf-4ccc-4022-83e4-d2f4c36955ee] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:57.020010 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_cell0:SELECT=2 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:57.021377 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_cell0:SELECT=6 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:22:57.028752 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5ab1b067-0423-4264-a6b6-fa70b0f34bee tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:57.029300 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5ab1b067-0423-4264-a6b6-fa70b0f34bee tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:57.030089 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5ab1b067-0423-4264-a6b6-fa70b0f34bee tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:57.030910 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5ab1b067-0423-4264-a6b6-fa70b0f34bee tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:57.172439 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-5ab1b067-0423-4264-a6b6-fa70b0f34bee tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:57.180291 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-5ab1b067-0423-4264-a6b6-fa70b0f34bee tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee" status: 200 len: 1522 microversion: 2.1 time: 0.167273 Jun 22 10:22:57.180880 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 158/338] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:57 2022] GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:57.827818 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-e24892d3-e005-4be1-8b69-a17efb9344b4 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:57.828443 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-e24892d3-e005-4be1-8b69-a17efb9344b4 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 1236b62e-0b77-4a1e-8e13-86eb3aa55773] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:57.835289 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e24892d3-e005-4be1-8b69-a17efb9344b4 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:57.835742 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e24892d3-e005-4be1-8b69-a17efb9344b4 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:57.836526 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e24892d3-e005-4be1-8b69-a17efb9344b4 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:57.836959 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e24892d3-e005-4be1-8b69-a17efb9344b4 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:57.978548 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-e24892d3-e005-4be1-8b69-a17efb9344b4 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5370eb5245247a68d7f224cdd457ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:57.986573 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-e24892d3-e005-4be1-8b69-a17efb9344b4 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "GET /compute/v2.1/servers/1236b62e-0b77-4a1e-8e13-86eb3aa55773" status: 200 len: 1314 microversion: 2.1 time: 0.162632 Jun 22 10:22:57.987177 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 181/339] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:57 2022] GET /compute/v2.1/servers/1236b62e-0b77-4a1e-8e13-86eb3aa55773 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:22:58.197780 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-c4968a43-b0bc-4573-8d75-7bb498491400 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:58.198385 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-c4968a43-b0bc-4573-8d75-7bb498491400 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 739e9dbf-4ccc-4022-83e4-d2f4c36955ee] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:58.205338 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c4968a43-b0bc-4573-8d75-7bb498491400 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:58.205781 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c4968a43-b0bc-4573-8d75-7bb498491400 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:58.206583 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c4968a43-b0bc-4573-8d75-7bb498491400 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:58.207016 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c4968a43-b0bc-4573-8d75-7bb498491400 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:58.367724 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-c4968a43-b0bc-4573-8d75-7bb498491400 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:58.377142 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-c4968a43-b0bc-4573-8d75-7bb498491400 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee" status: 200 len: 1522 microversion: 2.1 time: 0.183228 Jun 22 10:22:58.377956 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 159/340] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:58 2022] GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:59.004110 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-be5a0a01-635e-4fe5-b608-c750dd042693 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:59.004677 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-be5a0a01-635e-4fe5-b608-c750dd042693 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 1236b62e-0b77-4a1e-8e13-86eb3aa55773] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:59.011603 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-be5a0a01-635e-4fe5-b608-c750dd042693 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:59.012053 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-be5a0a01-635e-4fe5-b608-c750dd042693 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:59.012842 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-be5a0a01-635e-4fe5-b608-c750dd042693 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:59.013278 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-be5a0a01-635e-4fe5-b608-c750dd042693 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:59.148862 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-be5a0a01-635e-4fe5-b608-c750dd042693 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5370eb5245247a68d7f224cdd457ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:59.156837 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-be5a0a01-635e-4fe5-b608-c750dd042693 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "GET /compute/v2.1/servers/1236b62e-0b77-4a1e-8e13-86eb3aa55773" status: 200 len: 1314 microversion: 2.1 time: 0.156796 Jun 22 10:22:59.157407 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 182/341] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:58 2022] GET /compute/v2.1/servers/1236b62e-0b77-4a1e-8e13-86eb3aa55773 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:22:59.399297 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-dc4dcfe9-c7d6-4d3f-9dc6-9fb630efd501 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:22:59.399907 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-dc4dcfe9-c7d6-4d3f-9dc6-9fb630efd501 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 739e9dbf-4ccc-4022-83e4-d2f4c36955ee] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:22:59.407221 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-dc4dcfe9-c7d6-4d3f-9dc6-9fb630efd501 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:59.407664 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-dc4dcfe9-c7d6-4d3f-9dc6-9fb630efd501 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:59.408440 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-dc4dcfe9-c7d6-4d3f-9dc6-9fb630efd501 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:22:59.408870 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-dc4dcfe9-c7d6-4d3f-9dc6-9fb630efd501 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:22:59.546670 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-dc4dcfe9-c7d6-4d3f-9dc6-9fb630efd501 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:22:59.554873 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-dc4dcfe9-c7d6-4d3f-9dc6-9fb630efd501 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee" status: 200 len: 1522 microversion: 2.1 time: 0.161158 Jun 22 10:22:59.555495 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 160/342] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:22:59 2022] GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:00.173242 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-92d39219-ee34-4965-8184-36bd49b343f7 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:00.173854 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-92d39219-ee34-4965-8184-36bd49b343f7 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 1236b62e-0b77-4a1e-8e13-86eb3aa55773] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:00.180523 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-92d39219-ee34-4965-8184-36bd49b343f7 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:00.180977 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-92d39219-ee34-4965-8184-36bd49b343f7 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:00.181763 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-92d39219-ee34-4965-8184-36bd49b343f7 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:00.182201 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-92d39219-ee34-4965-8184-36bd49b343f7 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:00.314264 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-92d39219-ee34-4965-8184-36bd49b343f7 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5370eb5245247a68d7f224cdd457ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:00.322372 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-92d39219-ee34-4965-8184-36bd49b343f7 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "GET /compute/v2.1/servers/1236b62e-0b77-4a1e-8e13-86eb3aa55773" status: 200 len: 1314 microversion: 2.1 time: 0.153005 Jun 22 10:23:00.322973 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 183/343] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:00 2022] GET /compute/v2.1/servers/1236b62e-0b77-4a1e-8e13-86eb3aa55773 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:00.571965 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-ad3e8b33-2e41-465f-8c5b-728c13eda556 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:00.572565 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-ad3e8b33-2e41-465f-8c5b-728c13eda556 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 739e9dbf-4ccc-4022-83e4-d2f4c36955ee] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:00.574976 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=4 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:00.580880 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ad3e8b33-2e41-465f-8c5b-728c13eda556 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:00.581366 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ad3e8b33-2e41-465f-8c5b-728c13eda556 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:00.582148 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ad3e8b33-2e41-465f-8c5b-728c13eda556 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:00.582596 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ad3e8b33-2e41-465f-8c5b-728c13eda556 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:00.719944 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-ad3e8b33-2e41-465f-8c5b-728c13eda556 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:00.728803 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-ad3e8b33-2e41-465f-8c5b-728c13eda556 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee" status: 200 len: 1522 microversion: 2.1 time: 0.160616 Jun 22 10:23:00.728803 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 161/344] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:00 2022] GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:01.339434 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-ea3c1701-0b66-4bae-afd0-279b38b7fab4 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:01.340435 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-ea3c1701-0b66-4bae-afd0-279b38b7fab4 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 1236b62e-0b77-4a1e-8e13-86eb3aa55773] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:01.346897 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ea3c1701-0b66-4bae-afd0-279b38b7fab4 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:01.347363 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ea3c1701-0b66-4bae-afd0-279b38b7fab4 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:01.348145 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ea3c1701-0b66-4bae-afd0-279b38b7fab4 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:01.348567 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ea3c1701-0b66-4bae-afd0-279b38b7fab4 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:01.505263 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-ea3c1701-0b66-4bae-afd0-279b38b7fab4 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5370eb5245247a68d7f224cdd457ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:01.513409 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-ea3c1701-0b66-4bae-afd0-279b38b7fab4 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "GET /compute/v2.1/servers/1236b62e-0b77-4a1e-8e13-86eb3aa55773" status: 200 len: 1314 microversion: 2.1 time: 0.177913 Jun 22 10:23:01.514037 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 184/345] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:01 2022] GET /compute/v2.1/servers/1236b62e-0b77-4a1e-8e13-86eb3aa55773 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:01.747568 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-ee93d0e5-6180-4664-9e64-06f9ddbf3bc1 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:01.748088 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-ee93d0e5-6180-4664-9e64-06f9ddbf3bc1 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 739e9dbf-4ccc-4022-83e4-d2f4c36955ee] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:01.755117 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ee93d0e5-6180-4664-9e64-06f9ddbf3bc1 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:01.755560 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ee93d0e5-6180-4664-9e64-06f9ddbf3bc1 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:01.756317 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ee93d0e5-6180-4664-9e64-06f9ddbf3bc1 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:01.756746 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ee93d0e5-6180-4664-9e64-06f9ddbf3bc1 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:01.890249 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-ee93d0e5-6180-4664-9e64-06f9ddbf3bc1 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:01.898127 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-ee93d0e5-6180-4664-9e64-06f9ddbf3bc1 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee" status: 200 len: 1522 microversion: 2.1 time: 0.154551 Jun 22 10:23:01.898754 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 162/346] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:01 2022] GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:02.531021 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-41ad5d1b-1882-4ff8-b0db-2cbf3cbfe674 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:02.531567 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-41ad5d1b-1882-4ff8-b0db-2cbf3cbfe674 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 1236b62e-0b77-4a1e-8e13-86eb3aa55773] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:02.538073 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-41ad5d1b-1882-4ff8-b0db-2cbf3cbfe674 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:02.538536 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-41ad5d1b-1882-4ff8-b0db-2cbf3cbfe674 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:02.539395 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-41ad5d1b-1882-4ff8-b0db-2cbf3cbfe674 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:02.539823 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-41ad5d1b-1882-4ff8-b0db-2cbf3cbfe674 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:02.673674 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-41ad5d1b-1882-4ff8-b0db-2cbf3cbfe674 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5370eb5245247a68d7f224cdd457ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:02.681649 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-41ad5d1b-1882-4ff8-b0db-2cbf3cbfe674 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "GET /compute/v2.1/servers/1236b62e-0b77-4a1e-8e13-86eb3aa55773" status: 200 len: 1314 microversion: 2.1 time: 0.154986 Jun 22 10:23:02.682210 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 185/347] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:02 2022] GET /compute/v2.1/servers/1236b62e-0b77-4a1e-8e13-86eb3aa55773 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:02.915963 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-e81d56b7-26d5-4419-8e93-5da4fcb471f9 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:02.916564 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-e81d56b7-26d5-4419-8e93-5da4fcb471f9 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 739e9dbf-4ccc-4022-83e4-d2f4c36955ee] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:02.923605 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e81d56b7-26d5-4419-8e93-5da4fcb471f9 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:02.924060 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e81d56b7-26d5-4419-8e93-5da4fcb471f9 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:02.924909 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e81d56b7-26d5-4419-8e93-5da4fcb471f9 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:02.925343 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e81d56b7-26d5-4419-8e93-5da4fcb471f9 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:03.055958 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-e81d56b7-26d5-4419-8e93-5da4fcb471f9 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:03.063909 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-e81d56b7-26d5-4419-8e93-5da4fcb471f9 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee" status: 200 len: 1522 microversion: 2.1 time: 0.151960 Jun 22 10:23:03.064474 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 163/348] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:02 2022] GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:03.699241 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-fa1e25b4-c88a-41f8-a2b6-be874252cf93 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:03.699813 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-fa1e25b4-c88a-41f8-a2b6-be874252cf93 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 1236b62e-0b77-4a1e-8e13-86eb3aa55773] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:03.701767 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_api:SELECT=74 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:03.707433 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fa1e25b4-c88a-41f8-a2b6-be874252cf93 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:03.707891 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fa1e25b4-c88a-41f8-a2b6-be874252cf93 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:03.708649 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fa1e25b4-c88a-41f8-a2b6-be874252cf93 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:03.709074 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fa1e25b4-c88a-41f8-a2b6-be874252cf93 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:03.841985 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-fa1e25b4-c88a-41f8-a2b6-be874252cf93 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5370eb5245247a68d7f224cdd457ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:03.849533 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-fa1e25b4-c88a-41f8-a2b6-be874252cf93 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "GET /compute/v2.1/servers/1236b62e-0b77-4a1e-8e13-86eb3aa55773" status: 200 len: 1314 microversion: 2.1 time: 0.154233 Jun 22 10:23:03.850092 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 186/349] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:03 2022] GET /compute/v2.1/servers/1236b62e-0b77-4a1e-8e13-86eb3aa55773 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:04.081489 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-cce0c42f-f8df-43c5-b258-dbcd6977602a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:04.082044 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-cce0c42f-f8df-43c5-b258-dbcd6977602a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 739e9dbf-4ccc-4022-83e4-d2f4c36955ee] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:04.089173 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-cce0c42f-f8df-43c5-b258-dbcd6977602a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:04.089660 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-cce0c42f-f8df-43c5-b258-dbcd6977602a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:04.090485 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-cce0c42f-f8df-43c5-b258-dbcd6977602a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:04.090958 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-cce0c42f-f8df-43c5-b258-dbcd6977602a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:04.224710 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-cce0c42f-f8df-43c5-b258-dbcd6977602a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:04.232779 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-cce0c42f-f8df-43c5-b258-dbcd6977602a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee" status: 200 len: 1522 microversion: 2.1 time: 0.155262 Jun 22 10:23:04.233329 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 164/350] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:04 2022] GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:04.866771 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-a8cbff1b-6d09-422d-92bb-01bb922f9a75 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:04.867322 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-a8cbff1b-6d09-422d-92bb-01bb922f9a75 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 1236b62e-0b77-4a1e-8e13-86eb3aa55773] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:04.873755 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a8cbff1b-6d09-422d-92bb-01bb922f9a75 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:04.874223 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a8cbff1b-6d09-422d-92bb-01bb922f9a75 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:04.875021 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a8cbff1b-6d09-422d-92bb-01bb922f9a75 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:04.875442 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a8cbff1b-6d09-422d-92bb-01bb922f9a75 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:05.005801 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-a8cbff1b-6d09-422d-92bb-01bb922f9a75 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5370eb5245247a68d7f224cdd457ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:05.013641 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-a8cbff1b-6d09-422d-92bb-01bb922f9a75 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "GET /compute/v2.1/servers/1236b62e-0b77-4a1e-8e13-86eb3aa55773" status: 200 len: 1314 microversion: 2.1 time: 0.150961 Jun 22 10:23:05.014211 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 187/351] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:04 2022] GET /compute/v2.1/servers/1236b62e-0b77-4a1e-8e13-86eb3aa55773 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:05.249631 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-1e826992-253c-4b4e-b301-d123c7acf581 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:05.250278 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-1e826992-253c-4b4e-b301-d123c7acf581 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 739e9dbf-4ccc-4022-83e4-d2f4c36955ee] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:05.257429 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1e826992-253c-4b4e-b301-d123c7acf581 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:05.257892 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1e826992-253c-4b4e-b301-d123c7acf581 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:05.258736 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1e826992-253c-4b4e-b301-d123c7acf581 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:05.259182 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1e826992-253c-4b4e-b301-d123c7acf581 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:05.396568 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-1e826992-253c-4b4e-b301-d123c7acf581 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:05.404617 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-1e826992-253c-4b4e-b301-d123c7acf581 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee" status: 200 len: 1522 microversion: 2.1 time: 0.159029 Jun 22 10:23:05.405616 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 165/352] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:05 2022] GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:06.030941 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-6fd04415-c6d7-4778-b7d7-a36513852fc4 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:06.031557 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-6fd04415-c6d7-4778-b7d7-a36513852fc4 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 1236b62e-0b77-4a1e-8e13-86eb3aa55773] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:06.038062 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6fd04415-c6d7-4778-b7d7-a36513852fc4 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:06.038529 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6fd04415-c6d7-4778-b7d7-a36513852fc4 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:06.039385 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6fd04415-c6d7-4778-b7d7-a36513852fc4 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:06.039745 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6fd04415-c6d7-4778-b7d7-a36513852fc4 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:06.172642 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-6fd04415-c6d7-4778-b7d7-a36513852fc4 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5370eb5245247a68d7f224cdd457ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:06.180333 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-6fd04415-c6d7-4778-b7d7-a36513852fc4 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "GET /compute/v2.1/servers/1236b62e-0b77-4a1e-8e13-86eb3aa55773" status: 200 len: 1314 microversion: 2.1 time: 0.153693 Jun 22 10:23:06.180890 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 188/353] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:06 2022] GET /compute/v2.1/servers/1236b62e-0b77-4a1e-8e13-86eb3aa55773 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:06.421717 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-256adee2-5a80-4941-8efb-f68aa35288f5 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:06.422345 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-256adee2-5a80-4941-8efb-f68aa35288f5 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 739e9dbf-4ccc-4022-83e4-d2f4c36955ee] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:06.429559 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-256adee2-5a80-4941-8efb-f68aa35288f5 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:06.430060 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-256adee2-5a80-4941-8efb-f68aa35288f5 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:06.430912 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-256adee2-5a80-4941-8efb-f68aa35288f5 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:06.431348 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-256adee2-5a80-4941-8efb-f68aa35288f5 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:06.446549 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_cell1:SELECT=100 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:06.565586 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-256adee2-5a80-4941-8efb-f68aa35288f5 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:06.573216 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-256adee2-5a80-4941-8efb-f68aa35288f5 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee" status: 200 len: 1522 microversion: 2.1 time: 0.155593 Jun 22 10:23:06.573791 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 166/354] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:06 2022] GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:07.196653 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-95495b5c-75e9-42c3-acf3-9807e216c41f tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:07.197284 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-95495b5c-75e9-42c3-acf3-9807e216c41f tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 1236b62e-0b77-4a1e-8e13-86eb3aa55773] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:07.203800 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-95495b5c-75e9-42c3-acf3-9807e216c41f tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:07.204255 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-95495b5c-75e9-42c3-acf3-9807e216c41f tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:07.207993 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-95495b5c-75e9-42c3-acf3-9807e216c41f tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:07.208538 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-95495b5c-75e9-42c3-acf3-9807e216c41f tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:07.344792 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-95495b5c-75e9-42c3-acf3-9807e216c41f tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5370eb5245247a68d7f224cdd457ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:07.352679 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-95495b5c-75e9-42c3-acf3-9807e216c41f tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "GET /compute/v2.1/servers/1236b62e-0b77-4a1e-8e13-86eb3aa55773" status: 200 len: 1314 microversion: 2.1 time: 0.159861 Jun 22 10:23:07.353396 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 189/355] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:07 2022] GET /compute/v2.1/servers/1236b62e-0b77-4a1e-8e13-86eb3aa55773 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:07.589542 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-426fbec7-aaa8-4f90-9e6a-5f3e67be50d2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:07.590069 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-426fbec7-aaa8-4f90-9e6a-5f3e67be50d2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 739e9dbf-4ccc-4022-83e4-d2f4c36955ee] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:07.597190 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-426fbec7-aaa8-4f90-9e6a-5f3e67be50d2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:07.597639 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-426fbec7-aaa8-4f90-9e6a-5f3e67be50d2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:07.598424 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-426fbec7-aaa8-4f90-9e6a-5f3e67be50d2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:07.599050 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-426fbec7-aaa8-4f90-9e6a-5f3e67be50d2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:07.729121 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-426fbec7-aaa8-4f90-9e6a-5f3e67be50d2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:07.737265 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-426fbec7-aaa8-4f90-9e6a-5f3e67be50d2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee" status: 200 len: 1522 microversion: 2.1 time: 0.151747 Jun 22 10:23:07.737835 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 167/356] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:07 2022] GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:08.369118 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-613c865a-3c72-4365-a909-cd613f5bc455 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:08.369738 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-613c865a-3c72-4365-a909-cd613f5bc455 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 1236b62e-0b77-4a1e-8e13-86eb3aa55773] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:08.375835 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-613c865a-3c72-4365-a909-cd613f5bc455 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:08.376274 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-613c865a-3c72-4365-a909-cd613f5bc455 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:08.377022 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-613c865a-3c72-4365-a909-cd613f5bc455 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:08.377444 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-613c865a-3c72-4365-a909-cd613f5bc455 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:08.512698 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-613c865a-3c72-4365-a909-cd613f5bc455 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5370eb5245247a68d7f224cdd457ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:08.520249 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-613c865a-3c72-4365-a909-cd613f5bc455 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "GET /compute/v2.1/servers/1236b62e-0b77-4a1e-8e13-86eb3aa55773" status: 200 len: 1314 microversion: 2.1 time: 0.155003 Jun 22 10:23:08.520931 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 190/357] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:08 2022] GET /compute/v2.1/servers/1236b62e-0b77-4a1e-8e13-86eb3aa55773 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:08.754919 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-ac0ef5be-b356-4c4a-93f7-7309dc908c1c tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:08.756168 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-ac0ef5be-b356-4c4a-93f7-7309dc908c1c tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 739e9dbf-4ccc-4022-83e4-d2f4c36955ee] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:08.762613 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ac0ef5be-b356-4c4a-93f7-7309dc908c1c tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:08.763069 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ac0ef5be-b356-4c4a-93f7-7309dc908c1c tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:08.763862 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ac0ef5be-b356-4c4a-93f7-7309dc908c1c tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:08.764305 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ac0ef5be-b356-4c4a-93f7-7309dc908c1c tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:09.004231 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-ac0ef5be-b356-4c4a-93f7-7309dc908c1c tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:09.015065 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-ac0ef5be-b356-4c4a-93f7-7309dc908c1c tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee" status: 200 len: 1522 microversion: 2.1 time: 0.264003 Jun 22 10:23:09.016314 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 168/358] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:08 2022] GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee => generated 1522 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:09.538421 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-4574498f-8951-406b-bff6-91fe6900f2d2 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:09.539039 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-4574498f-8951-406b-bff6-91fe6900f2d2 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 1236b62e-0b77-4a1e-8e13-86eb3aa55773] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:09.545411 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4574498f-8951-406b-bff6-91fe6900f2d2 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:09.545869 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4574498f-8951-406b-bff6-91fe6900f2d2 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:09.546677 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4574498f-8951-406b-bff6-91fe6900f2d2 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:09.547114 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4574498f-8951-406b-bff6-91fe6900f2d2 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:09.707326 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-4574498f-8951-406b-bff6-91fe6900f2d2 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5370eb5245247a68d7f224cdd457ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:09.716032 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-4574498f-8951-406b-bff6-91fe6900f2d2 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "GET /compute/v2.1/servers/1236b62e-0b77-4a1e-8e13-86eb3aa55773" status: 200 len: 1314 microversion: 2.1 time: 0.181542 Jun 22 10:23:09.716727 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 191/359] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:09 2022] GET /compute/v2.1/servers/1236b62e-0b77-4a1e-8e13-86eb3aa55773 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:10.033091 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-e0be880e-5636-4c94-87f4-e4ad4070de39 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:10.033659 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-e0be880e-5636-4c94-87f4-e4ad4070de39 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 739e9dbf-4ccc-4022-83e4-d2f4c36955ee] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:10.041691 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e0be880e-5636-4c94-87f4-e4ad4070de39 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:10.042246 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e0be880e-5636-4c94-87f4-e4ad4070de39 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:10.043116 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e0be880e-5636-4c94-87f4-e4ad4070de39 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:10.043508 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e0be880e-5636-4c94-87f4-e4ad4070de39 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:10.231214 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-e0be880e-5636-4c94-87f4-e4ad4070de39 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:10.239039 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-e0be880e-5636-4c94-87f4-e4ad4070de39 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee" status: 200 len: 1522 microversion: 2.1 time: 0.210298 Jun 22 10:23:10.239619 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 169/360] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:10 2022] GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:10.736995 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-dd13d728-fafc-441f-8060-cfd042986aa0 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:10.738280 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-dd13d728-fafc-441f-8060-cfd042986aa0 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 1236b62e-0b77-4a1e-8e13-86eb3aa55773] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:10.756194 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-dd13d728-fafc-441f-8060-cfd042986aa0 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:10.756644 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-dd13d728-fafc-441f-8060-cfd042986aa0 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:10.757481 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-dd13d728-fafc-441f-8060-cfd042986aa0 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:10.757972 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-dd13d728-fafc-441f-8060-cfd042986aa0 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:11.018845 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-dd13d728-fafc-441f-8060-cfd042986aa0 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5370eb5245247a68d7f224cdd457ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:11.029238 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-dd13d728-fafc-441f-8060-cfd042986aa0 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "GET /compute/v2.1/servers/1236b62e-0b77-4a1e-8e13-86eb3aa55773" status: 200 len: 1314 microversion: 2.1 time: 0.299079 Jun 22 10:23:11.035193 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-3e0c2d5a-adf3-4fc8-bb63-7c55ef4f94ef req-7d385808-a11d-48f3-b1e9-8ce8e4cf9520 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1236b62e-0b77-4a1e-8e13-86eb3aa55773", "name": "network-vif-plugged", "status": "completed", "tag": "2c070c8b-8bd7-48f9-bfcd-16e7e0242446"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:23:11.040701 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 192/361] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:10 2022] GET /compute/v2.1/servers/1236b62e-0b77-4a1e-8e13-86eb3aa55773 => generated 1314 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:11.044455 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-3e0c2d5a-adf3-4fc8-bb63-7c55ef4f94ef req-7d385808-a11d-48f3-b1e9-8ce8e4cf9520 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:11.044976 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-3e0c2d5a-adf3-4fc8-bb63-7c55ef4f94ef req-7d385808-a11d-48f3-b1e9-8ce8e4cf9520 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:11.057942 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-3e0c2d5a-adf3-4fc8-bb63-7c55ef4f94ef req-7d385808-a11d-48f3-b1e9-8ce8e4cf9520 service nova] Creating event network-vif-plugged:2c070c8b-8bd7-48f9-bfcd-16e7e0242446 for instance 1236b62e-0b77-4a1e-8e13-86eb3aa55773 on hv-cinder-84713 Jun 22 10:23:11.063942 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-3e0c2d5a-adf3-4fc8-bb63-7c55ef4f94ef req-7d385808-a11d-48f3-b1e9-8ce8e4cf9520 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032402 Jun 22 10:23:11.064636 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 170/362] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:23:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:23:11.256339 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-3b7ec083-8567-4032-a401-1ba0696dee36 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:11.257015 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-3b7ec083-8567-4032-a401-1ba0696dee36 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 739e9dbf-4ccc-4022-83e4-d2f4c36955ee] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:11.266361 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3b7ec083-8567-4032-a401-1ba0696dee36 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:11.267055 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3b7ec083-8567-4032-a401-1ba0696dee36 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:11.268027 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3b7ec083-8567-4032-a401-1ba0696dee36 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:11.268612 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3b7ec083-8567-4032-a401-1ba0696dee36 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:11.429897 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-3b7ec083-8567-4032-a401-1ba0696dee36 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:11.438167 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-3b7ec083-8567-4032-a401-1ba0696dee36 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee" status: 200 len: 1522 microversion: 2.1 time: 0.185996 Jun 22 10:23:11.438764 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 193/363] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:11 2022] GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:11.964299 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-5c9e5dd3-1438-468c-9642-25c3a8effdfe tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-63829833", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-666635953", "security_groups": [{"name": "tempest-secgroup-smoke-1054534713"}], "block_device_mapping_v2": [{"uuid": "ce01a44b-1534-4b61-973f-2ec7c2800dac", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b0565ff5-0ad4-4a38-9f47-51304a15abc7"}]}} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:23:12.052449 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-e9a8128d-d0c1-4e62-a38d-acde4beb03da tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:12.052981 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-e9a8128d-d0c1-4e62-a38d-acde4beb03da tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 1236b62e-0b77-4a1e-8e13-86eb3aa55773] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:12.060184 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e9a8128d-d0c1-4e62-a38d-acde4beb03da tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:12.060884 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e9a8128d-d0c1-4e62-a38d-acde4beb03da tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:12.061863 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e9a8128d-d0c1-4e62-a38d-acde4beb03da tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:12.062720 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e9a8128d-d0c1-4e62-a38d-acde4beb03da tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:12.083838 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.network.neutron [None req-5c9e5dd3-1438-468c-9642-25c3a8effdfe tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] validate_networks() for [('b0565ff5-0ad4-4a38-9f47-51304a15abc7', None, None, None, None, None)] {{(pid=117679) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 10:23:12.298717 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-e9a8128d-d0c1-4e62-a38d-acde4beb03da tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5370eb5245247a68d7f224cdd457ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:12.311482 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-e9a8128d-d0c1-4e62-a38d-acde4beb03da tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "GET /compute/v2.1/servers/1236b62e-0b77-4a1e-8e13-86eb3aa55773" status: 200 len: 1314 microversion: 2.1 time: 0.268157 Jun 22 10:23:12.312430 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 194/364] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:12 2022] GET /compute/v2.1/servers/1236b62e-0b77-4a1e-8e13-86eb3aa55773 => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:12.456757 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-cf421225-d01d-496d-bb4d-01924c8d0cdc tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:12.457370 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-cf421225-d01d-496d-bb4d-01924c8d0cdc tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 739e9dbf-4ccc-4022-83e4-d2f4c36955ee] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:12.463712 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-cf421225-d01d-496d-bb4d-01924c8d0cdc tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:12.464261 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-cf421225-d01d-496d-bb4d-01924c8d0cdc tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:12.465042 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-cf421225-d01d-496d-bb4d-01924c8d0cdc tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:12.465509 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-cf421225-d01d-496d-bb4d-01924c8d0cdc tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:12.486046 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:12.599528 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-5c9e5dd3-1438-468c-9642-25c3a8effdfe tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Flavor limits 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 10:23:12.600645 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-5c9e5dd3-1438-468c-9642-25c3a8effdfe tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Image limits 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 10:23:12.601259 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-5c9e5dd3-1438-468c-9642-25c3a8effdfe tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Flavor pref 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 10:23:12.602091 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-5c9e5dd3-1438-468c-9642-25c3a8effdfe tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Image pref 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 10:23:12.602582 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-5c9e5dd3-1438-468c-9642-25c3a8effdfe tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 10:23:12.613115 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5c9e5dd3-1438-468c-9642-25c3a8effdfe tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:12.613646 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5c9e5dd3-1438-468c-9642-25c3a8effdfe tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:12.614735 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5c9e5dd3-1438-468c-9642-25c3a8effdfe tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:12.615701 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5c9e5dd3-1438-468c-9642-25c3a8effdfe tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:12.635120 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.quota [None req-5c9e5dd3-1438-468c-9642-25c3a8effdfe tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Getting quotas for project a4a87feacfb84d6c9f7ea48f230753b7. Resources: {'instances', 'cores', 'ram'} {{(pid=117679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:23:12.647740 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.quota [None req-5c9e5dd3-1438-468c-9642-25c3a8effdfe tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Getting quotas for user a394fc62e6a64a85b855bf2eb56b4b71 and project a4a87feacfb84d6c9f7ea48f230753b7. Resources: {'instances', 'cores', 'ram'} {{(pid=117679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:23:12.665297 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-cf421225-d01d-496d-bb4d-01924c8d0cdc tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:12.673195 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-cf421225-d01d-496d-bb4d-01924c8d0cdc tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee" status: 200 len: 1522 microversion: 2.1 time: 0.221900 Jun 22 10:23:12.674200 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 195/365] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:12 2022] GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:12.716420 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-5c9e5dd3-1438-468c-9642-25c3a8effdfe tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Going to run 1 instances... {{(pid=117679) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 10:23:12.718622 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-5c9e5dd3-1438-468c-9642-25c3a8effdfe tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 3cc6d1fb-02b4-411e-84a2-eb5a63344e0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ce01a44b-1534-4b61-973f-2ec7c2800dac',volume_size=None,volume_type=None)] {{(pid=117679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 10:23:12.861264 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-5c9e5dd3-1438-468c-9642-25c3a8effdfe tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.901483 Jun 22 10:23:12.862239 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 171/366] 10.222.0.66 () {60 vars in 1146 bytes} [Wed Jun 22 10:23:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 903 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 10:23:12.872532 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-4f3ac91f-bcc5-46fd-b2d9-f18f6661c90a tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:12.873244 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-4f3ac91f-bcc5-46fd-b2d9-f18f6661c90a tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 3cc6d1fb-02b4-411e-84a2-eb5a63344e0d] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:12.934668 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-4f3ac91f-bcc5-46fd-b2d9-f18f6661c90a tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a394fc62e6a64a85b855bf2eb56b4b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a87feacfb84d6c9f7ea48f230753b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:12.942693 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-4f3ac91f-bcc5-46fd-b2d9-f18f6661c90a tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "GET /compute/v2.1/servers/3cc6d1fb-02b4-411e-84a2-eb5a63344e0d" status: 200 len: 1092 microversion: 2.1 time: 0.074355 Jun 22 10:23:12.944412 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 196/367] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:12 2022] GET /compute/v2.1/servers/3cc6d1fb-02b4-411e-84a2-eb5a63344e0d => generated 1092 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:13.328985 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-a3704141-847d-4b59-9332-213d7a6e4164 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:13.329820 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-a3704141-847d-4b59-9332-213d7a6e4164 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 1236b62e-0b77-4a1e-8e13-86eb3aa55773] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:13.338295 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a3704141-847d-4b59-9332-213d7a6e4164 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:13.338771 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a3704141-847d-4b59-9332-213d7a6e4164 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:13.339552 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a3704141-847d-4b59-9332-213d7a6e4164 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:13.339982 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a3704141-847d-4b59-9332-213d7a6e4164 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:13.484625 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-a3704141-847d-4b59-9332-213d7a6e4164 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5370eb5245247a68d7f224cdd457ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:13.492994 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-a3704141-847d-4b59-9332-213d7a6e4164 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "GET /compute/v2.1/servers/1236b62e-0b77-4a1e-8e13-86eb3aa55773" status: 200 len: 1314 microversion: 2.1 time: 0.168409 Jun 22 10:23:13.493689 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 172/368] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:13 2022] GET /compute/v2.1/servers/1236b62e-0b77-4a1e-8e13-86eb3aa55773 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:13.690762 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-7e82be1c-bd18-42ad-a024-3e4064280306 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:13.691516 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-7e82be1c-bd18-42ad-a024-3e4064280306 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 739e9dbf-4ccc-4022-83e4-d2f4c36955ee] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:13.697938 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7e82be1c-bd18-42ad-a024-3e4064280306 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:13.698389 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7e82be1c-bd18-42ad-a024-3e4064280306 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:13.699278 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7e82be1c-bd18-42ad-a024-3e4064280306 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:13.699716 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7e82be1c-bd18-42ad-a024-3e4064280306 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:13.842235 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-7e82be1c-bd18-42ad-a024-3e4064280306 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:13.850935 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-7e82be1c-bd18-42ad-a024-3e4064280306 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee" status: 200 len: 1522 microversion: 2.1 time: 0.164430 Jun 22 10:23:13.851632 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 197/369] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:13 2022] GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:13.960499 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-cf4b951b-41ed-4bb3-a1c9-963628ce1ad2 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:13.961148 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-cf4b951b-41ed-4bb3-a1c9-963628ce1ad2 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 3cc6d1fb-02b4-411e-84a2-eb5a63344e0d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:13.967992 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-cf4b951b-41ed-4bb3-a1c9-963628ce1ad2 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:13.968447 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-cf4b951b-41ed-4bb3-a1c9-963628ce1ad2 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:13.969224 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-cf4b951b-41ed-4bb3-a1c9-963628ce1ad2 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:13.969647 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-cf4b951b-41ed-4bb3-a1c9-963628ce1ad2 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:14.035248 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-cf4b951b-41ed-4bb3-a1c9-963628ce1ad2 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a394fc62e6a64a85b855bf2eb56b4b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a87feacfb84d6c9f7ea48f230753b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:14.042885 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-cf4b951b-41ed-4bb3-a1c9-963628ce1ad2 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "GET /compute/v2.1/servers/3cc6d1fb-02b4-411e-84a2-eb5a63344e0d" status: 200 len: 1190 microversion: 2.1 time: 0.086353 Jun 22 10:23:14.043700 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 173/370] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:13 2022] GET /compute/v2.1/servers/3cc6d1fb-02b4-411e-84a2-eb5a63344e0d => generated 1190 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:14.510420 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-86c6cff8-b067-4aa7-be25-38d24ddd4aab tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:14.511123 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-86c6cff8-b067-4aa7-be25-38d24ddd4aab tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 1236b62e-0b77-4a1e-8e13-86eb3aa55773] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:14.517830 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-86c6cff8-b067-4aa7-be25-38d24ddd4aab tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:14.518364 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-86c6cff8-b067-4aa7-be25-38d24ddd4aab tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:14.519173 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-86c6cff8-b067-4aa7-be25-38d24ddd4aab tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:14.519618 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-86c6cff8-b067-4aa7-be25-38d24ddd4aab tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:14.751943 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-86c6cff8-b067-4aa7-be25-38d24ddd4aab tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5370eb5245247a68d7f224cdd457ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:14.762759 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-86c6cff8-b067-4aa7-be25-38d24ddd4aab tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "GET /compute/v2.1/servers/1236b62e-0b77-4a1e-8e13-86eb3aa55773" status: 200 len: 1499 microversion: 2.1 time: 0.254307 Jun 22 10:23:14.772261 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 198/371] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:14 2022] GET /compute/v2.1/servers/1236b62e-0b77-4a1e-8e13-86eb3aa55773 => generated 1499 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:14.873961 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-90d57c6e-aaa8-4244-9bbc-6fd37de077c5 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:14.877496 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-90d57c6e-aaa8-4244-9bbc-6fd37de077c5 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 739e9dbf-4ccc-4022-83e4-d2f4c36955ee] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:14.891835 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-90d57c6e-aaa8-4244-9bbc-6fd37de077c5 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:14.892297 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-90d57c6e-aaa8-4244-9bbc-6fd37de077c5 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:14.893296 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-90d57c6e-aaa8-4244-9bbc-6fd37de077c5 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:14.893748 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-90d57c6e-aaa8-4244-9bbc-6fd37de077c5 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:15.068968 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-7691f668-d0d5-4efc-8a55-e59ba3b1e233 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:15.074483 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-7691f668-d0d5-4efc-8a55-e59ba3b1e233 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 3cc6d1fb-02b4-411e-84a2-eb5a63344e0d] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:15.091248 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7691f668-d0d5-4efc-8a55-e59ba3b1e233 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:15.091705 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7691f668-d0d5-4efc-8a55-e59ba3b1e233 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:15.092512 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7691f668-d0d5-4efc-8a55-e59ba3b1e233 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:15.092955 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7691f668-d0d5-4efc-8a55-e59ba3b1e233 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:15.177110 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-90d57c6e-aaa8-4244-9bbc-6fd37de077c5 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:15.185496 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-90d57c6e-aaa8-4244-9bbc-6fd37de077c5 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee" status: 200 len: 1522 microversion: 2.1 time: 0.319800 Jun 22 10:23:15.186483 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 174/372] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:14 2022] GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee => generated 1522 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:15.364242 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-7691f668-d0d5-4efc-8a55-e59ba3b1e233 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a394fc62e6a64a85b855bf2eb56b4b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a87feacfb84d6c9f7ea48f230753b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:15.365266 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-36485cda-e5f5-4beb-ad6c-f36eff20fc56 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:15.365834 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-36485cda-e5f5-4beb-ad6c-f36eff20fc56 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 1236b62e-0b77-4a1e-8e13-86eb3aa55773] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:15.373502 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-36485cda-e5f5-4beb-ad6c-f36eff20fc56 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:15.373879 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-7691f668-d0d5-4efc-8a55-e59ba3b1e233 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "GET /compute/v2.1/servers/3cc6d1fb-02b4-411e-84a2-eb5a63344e0d" status: 200 len: 1264 microversion: 2.1 time: 0.315273 Jun 22 10:23:15.374147 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-36485cda-e5f5-4beb-ad6c-f36eff20fc56 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:15.384062 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-36485cda-e5f5-4beb-ad6c-f36eff20fc56 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:15.384275 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 199/373] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:15 2022] GET /compute/v2.1/servers/3cc6d1fb-02b4-411e-84a2-eb5a63344e0d => generated 1264 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:23:15.384397 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-36485cda-e5f5-4beb-ad6c-f36eff20fc56 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:15.403176 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-36485cda-e5f5-4beb-ad6c-f36eff20fc56 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 1236b62e-0b77-4a1e-8e13-86eb3aa55773] Going to try to terminate instance {{(pid=117679) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 10:23:15.491475 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-36485cda-e5f5-4beb-ad6c-f36eff20fc56 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "DELETE /compute/v2.1/servers/1236b62e-0b77-4a1e-8e13-86eb3aa55773" status: 204 len: 0 microversion: 2.1 time: 0.130092 Jun 22 10:23:15.494582 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 175/374] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Jun 22 10:23:15 2022] DELETE /compute/v2.1/servers/1236b62e-0b77-4a1e-8e13-86eb3aa55773 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 22 10:23:15.501428 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-d8fe77dd-4382-443c-a95b-6983f8031f3b tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:15.502035 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-d8fe77dd-4382-443c-a95b-6983f8031f3b tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 1236b62e-0b77-4a1e-8e13-86eb3aa55773] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:15.509806 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d8fe77dd-4382-443c-a95b-6983f8031f3b tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:15.510252 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d8fe77dd-4382-443c-a95b-6983f8031f3b tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:15.511047 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d8fe77dd-4382-443c-a95b-6983f8031f3b tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:15.511475 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d8fe77dd-4382-443c-a95b-6983f8031f3b tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:15.738658 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-d8fe77dd-4382-443c-a95b-6983f8031f3b tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5370eb5245247a68d7f224cdd457ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:15.746561 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-d8fe77dd-4382-443c-a95b-6983f8031f3b tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "GET /compute/v2.1/servers/1236b62e-0b77-4a1e-8e13-86eb3aa55773" status: 200 len: 1505 microversion: 2.1 time: 0.249640 Jun 22 10:23:15.747244 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 200/375] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:15 2022] GET /compute/v2.1/servers/1236b62e-0b77-4a1e-8e13-86eb3aa55773 => generated 1505 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:15.985333 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-85be9689-1aff-457b-b2e8-2a9be44a3e36 req-e61bf786-59d0-43fe-a1f4-71d0b945557d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cc6d1fb-02b4-411e-84a2-eb5a63344e0d", "tag": "929e1349-8efe-439a-9035-3dbc4bc6c6a8"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:23:15.994959 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-85be9689-1aff-457b-b2e8-2a9be44a3e36 req-e61bf786-59d0-43fe-a1f4-71d0b945557d service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:15.995388 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-85be9689-1aff-457b-b2e8-2a9be44a3e36 req-e61bf786-59d0-43fe-a1f4-71d0b945557d service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:16.008667 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-85be9689-1aff-457b-b2e8-2a9be44a3e36 req-e61bf786-59d0-43fe-a1f4-71d0b945557d service nova] Creating event network-changed:929e1349-8efe-439a-9035-3dbc4bc6c6a8 for instance 3cc6d1fb-02b4-411e-84a2-eb5a63344e0d on hv-cinder-84713 Jun 22 10:23:16.013530 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-85be9689-1aff-457b-b2e8-2a9be44a3e36 req-e61bf786-59d0-43fe-a1f4-71d0b945557d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032219 Jun 22 10:23:16.014308 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 176/376] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:23:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:23:16.202864 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-e126feae-c17b-4f62-a202-bdcf4f77e8c1 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:16.203455 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-e126feae-c17b-4f62-a202-bdcf4f77e8c1 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 739e9dbf-4ccc-4022-83e4-d2f4c36955ee] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:16.210111 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e126feae-c17b-4f62-a202-bdcf4f77e8c1 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:16.211139 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e126feae-c17b-4f62-a202-bdcf4f77e8c1 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:16.212020 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e126feae-c17b-4f62-a202-bdcf4f77e8c1 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:16.212464 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e126feae-c17b-4f62-a202-bdcf4f77e8c1 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:16.351399 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-e126feae-c17b-4f62-a202-bdcf4f77e8c1 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:16.358956 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-e126feae-c17b-4f62-a202-bdcf4f77e8c1 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee" status: 200 len: 1522 microversion: 2.1 time: 0.160029 Jun 22 10:23:16.359630 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 201/377] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:16 2022] GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:16.392879 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-929a8237-b56e-451d-aca7-1b000116d5dc tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:16.393583 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-929a8237-b56e-451d-aca7-1b000116d5dc tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 3cc6d1fb-02b4-411e-84a2-eb5a63344e0d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:16.403998 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-929a8237-b56e-451d-aca7-1b000116d5dc tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:16.404449 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-929a8237-b56e-451d-aca7-1b000116d5dc tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:16.405536 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-929a8237-b56e-451d-aca7-1b000116d5dc tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:16.405974 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-929a8237-b56e-451d-aca7-1b000116d5dc tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:16.546974 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-929a8237-b56e-451d-aca7-1b000116d5dc tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a394fc62e6a64a85b855bf2eb56b4b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a87feacfb84d6c9f7ea48f230753b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:16.555142 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-929a8237-b56e-451d-aca7-1b000116d5dc tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "GET /compute/v2.1/servers/3cc6d1fb-02b4-411e-84a2-eb5a63344e0d" status: 200 len: 1264 microversion: 2.1 time: 0.166976 Jun 22 10:23:16.556149 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 177/378] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:16 2022] GET /compute/v2.1/servers/3cc6d1fb-02b4-411e-84a2-eb5a63344e0d => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:16.764529 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-f1137b67-c7b9-4d3c-b3cc-19230ec599e4 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:16.765132 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-f1137b67-c7b9-4d3c-b3cc-19230ec599e4 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 1236b62e-0b77-4a1e-8e13-86eb3aa55773] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:16.771572 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f1137b67-c7b9-4d3c-b3cc-19230ec599e4 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:16.772162 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f1137b67-c7b9-4d3c-b3cc-19230ec599e4 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:16.773050 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f1137b67-c7b9-4d3c-b3cc-19230ec599e4 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:16.773699 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f1137b67-c7b9-4d3c-b3cc-19230ec599e4 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:17.048190 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-f1137b67-c7b9-4d3c-b3cc-19230ec599e4 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5370eb5245247a68d7f224cdd457ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:17.056770 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-f1137b67-c7b9-4d3c-b3cc-19230ec599e4 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "GET /compute/v2.1/servers/1236b62e-0b77-4a1e-8e13-86eb3aa55773" status: 200 len: 1505 microversion: 2.1 time: 0.296467 Jun 22 10:23:17.057376 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 202/379] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:16 2022] GET /compute/v2.1/servers/1236b62e-0b77-4a1e-8e13-86eb3aa55773 => generated 1505 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:17.386074 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-0284ec63-8fd4-4816-b84c-80e6ef4f84ac tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:17.390035 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-0284ec63-8fd4-4816-b84c-80e6ef4f84ac tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 739e9dbf-4ccc-4022-83e4-d2f4c36955ee] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:17.407732 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0284ec63-8fd4-4816-b84c-80e6ef4f84ac tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:17.408699 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0284ec63-8fd4-4816-b84c-80e6ef4f84ac tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:17.411598 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0284ec63-8fd4-4816-b84c-80e6ef4f84ac tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:17.412533 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0284ec63-8fd4-4816-b84c-80e6ef4f84ac tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:17.576276 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-318ab447-396b-4bd0-b447-3c8d7826a4e7 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:17.576966 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-318ab447-396b-4bd0-b447-3c8d7826a4e7 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 3cc6d1fb-02b4-411e-84a2-eb5a63344e0d] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:17.584622 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-318ab447-396b-4bd0-b447-3c8d7826a4e7 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:17.585365 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-318ab447-396b-4bd0-b447-3c8d7826a4e7 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:17.586980 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-318ab447-396b-4bd0-b447-3c8d7826a4e7 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:17.589078 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-318ab447-396b-4bd0-b447-3c8d7826a4e7 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:17.722189 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-0284ec63-8fd4-4816-b84c-80e6ef4f84ac tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:17.732343 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-0284ec63-8fd4-4816-b84c-80e6ef4f84ac tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee" status: 200 len: 1522 microversion: 2.1 time: 0.359368 Jun 22 10:23:17.732937 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 178/380] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:17 2022] GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee => generated 1522 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:17.886857 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-318ab447-396b-4bd0-b447-3c8d7826a4e7 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a394fc62e6a64a85b855bf2eb56b4b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a87feacfb84d6c9f7ea48f230753b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:17.895735 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-318ab447-396b-4bd0-b447-3c8d7826a4e7 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "GET /compute/v2.1/servers/3cc6d1fb-02b4-411e-84a2-eb5a63344e0d" status: 200 len: 1264 microversion: 2.1 time: 0.323668 Jun 22 10:23:17.896322 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 203/381] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:17 2022] GET /compute/v2.1/servers/3cc6d1fb-02b4-411e-84a2-eb5a63344e0d => generated 1264 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:17.919577 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-138ed8ea-7fce-448c-946f-6ee429b30444 req-4c87f934-906a-4c3d-9243-14501d1b2d02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1236b62e-0b77-4a1e-8e13-86eb3aa55773", "name": "network-vif-deleted", "tag": "2c070c8b-8bd7-48f9-bfcd-16e7e0242446"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:23:17.929971 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-138ed8ea-7fce-448c-946f-6ee429b30444 req-4c87f934-906a-4c3d-9243-14501d1b2d02 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:17.930758 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-138ed8ea-7fce-448c-946f-6ee429b30444 req-4c87f934-906a-4c3d-9243-14501d1b2d02 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:17.945723 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-138ed8ea-7fce-448c-946f-6ee429b30444 req-4c87f934-906a-4c3d-9243-14501d1b2d02 service nova] Creating event network-vif-deleted:2c070c8b-8bd7-48f9-bfcd-16e7e0242446 for instance 1236b62e-0b77-4a1e-8e13-86eb3aa55773 on hv-cinder-84713 Jun 22 10:23:17.950749 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-138ed8ea-7fce-448c-946f-6ee429b30444 req-4c87f934-906a-4c3d-9243-14501d1b2d02 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035671 Jun 22 10:23:17.951349 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 179/382] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:23:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:23:18.074054 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-6d7a3dac-27a3-4c5b-8a69-631e9cc54103 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:18.074964 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-6d7a3dac-27a3-4c5b-8a69-631e9cc54103 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 1236b62e-0b77-4a1e-8e13-86eb3aa55773] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:18.081478 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6d7a3dac-27a3-4c5b-8a69-631e9cc54103 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:18.081923 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6d7a3dac-27a3-4c5b-8a69-631e9cc54103 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:18.082750 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6d7a3dac-27a3-4c5b-8a69-631e9cc54103 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:18.083365 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6d7a3dac-27a3-4c5b-8a69-631e9cc54103 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:18.126969 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6d7a3dac-27a3-4c5b-8a69-631e9cc54103 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:18.127792 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6d7a3dac-27a3-4c5b-8a69-631e9cc54103 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:18.128607 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.objects.instance [None req-6d7a3dac-27a3-4c5b-8a69-631e9cc54103 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lazy-loading 'fault' on Instance uuid 1236b62e-0b77-4a1e-8e13-86eb3aa55773 {{(pid=117680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:23:18.185131 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-6d7a3dac-27a3-4c5b-8a69-631e9cc54103 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5370eb5245247a68d7f224cdd457ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:18.194130 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-6d7a3dac-27a3-4c5b-8a69-631e9cc54103 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "GET /compute/v2.1/servers/1236b62e-0b77-4a1e-8e13-86eb3aa55773" status: 200 len: 1304 microversion: 2.1 time: 0.124041 Jun 22 10:23:18.204387 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 204/383] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:18 2022] GET /compute/v2.1/servers/1236b62e-0b77-4a1e-8e13-86eb3aa55773 => generated 1304 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:18.751016 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-809d7042-8149-465f-8da3-d15b25ba86c9 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:18.751693 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-809d7042-8149-465f-8da3-d15b25ba86c9 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 739e9dbf-4ccc-4022-83e4-d2f4c36955ee] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:18.758881 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-809d7042-8149-465f-8da3-d15b25ba86c9 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:18.759105 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-809d7042-8149-465f-8da3-d15b25ba86c9 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:18.759876 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-809d7042-8149-465f-8da3-d15b25ba86c9 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:18.760313 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-809d7042-8149-465f-8da3-d15b25ba86c9 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:18.904733 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-809d7042-8149-465f-8da3-d15b25ba86c9 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:18.914210 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-19bde244-c69f-47c3-b206-fef51489754c tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:18.916043 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-19bde244-c69f-47c3-b206-fef51489754c tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 3cc6d1fb-02b4-411e-84a2-eb5a63344e0d] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:18.918523 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-809d7042-8149-465f-8da3-d15b25ba86c9 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee" status: 200 len: 1522 microversion: 2.1 time: 0.171956 Jun 22 10:23:18.923719 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-19bde244-c69f-47c3-b206-fef51489754c tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:18.924320 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-19bde244-c69f-47c3-b206-fef51489754c tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:18.925457 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-19bde244-c69f-47c3-b206-fef51489754c tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:18.925916 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-19bde244-c69f-47c3-b206-fef51489754c tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:18.938135 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 180/384] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:18 2022] GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:19.066016 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-19bde244-c69f-47c3-b206-fef51489754c tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a394fc62e6a64a85b855bf2eb56b4b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a87feacfb84d6c9f7ea48f230753b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:19.074963 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-19bde244-c69f-47c3-b206-fef51489754c tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "GET /compute/v2.1/servers/3cc6d1fb-02b4-411e-84a2-eb5a63344e0d" status: 200 len: 1264 microversion: 2.1 time: 0.166054 Jun 22 10:23:19.076539 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 205/385] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:18 2022] GET /compute/v2.1/servers/3cc6d1fb-02b4-411e-84a2-eb5a63344e0d => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:23:19.212549 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-a250195d-0152-4ec9-a064-3bbc84586406 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:19.213152 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-a250195d-0152-4ec9-a064-3bbc84586406 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 1236b62e-0b77-4a1e-8e13-86eb3aa55773] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:19.219638 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a250195d-0152-4ec9-a064-3bbc84586406 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:19.220071 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a250195d-0152-4ec9-a064-3bbc84586406 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:19.220866 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a250195d-0152-4ec9-a064-3bbc84586406 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:19.221270 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a250195d-0152-4ec9-a064-3bbc84586406 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:19.252827 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a250195d-0152-4ec9-a064-3bbc84586406 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:19.253280 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a250195d-0152-4ec9-a064-3bbc84586406 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:19.253737 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.objects.instance [None req-a250195d-0152-4ec9-a064-3bbc84586406 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lazy-loading 'fault' on Instance uuid 1236b62e-0b77-4a1e-8e13-86eb3aa55773 {{(pid=117679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:23:19.298273 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-a250195d-0152-4ec9-a064-3bbc84586406 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d1dcf4b8dbb4e1698e7b0c4dc9c63a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5370eb5245247a68d7f224cdd457ea1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:19.306247 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-a250195d-0152-4ec9-a064-3bbc84586406 tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "GET /compute/v2.1/servers/1236b62e-0b77-4a1e-8e13-86eb3aa55773" status: 200 len: 1304 microversion: 2.1 time: 0.097792 Jun 22 10:23:19.307021 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 181/386] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:19 2022] GET /compute/v2.1/servers/1236b62e-0b77-4a1e-8e13-86eb3aa55773 => generated 1304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:19.936055 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-f1287d7f-bfef-40a6-bd95-10c65bf4fa59 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:19.936681 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-f1287d7f-bfef-40a6-bd95-10c65bf4fa59 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 739e9dbf-4ccc-4022-83e4-d2f4c36955ee] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:19.943184 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f1287d7f-bfef-40a6-bd95-10c65bf4fa59 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:19.943627 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f1287d7f-bfef-40a6-bd95-10c65bf4fa59 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:19.944406 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f1287d7f-bfef-40a6-bd95-10c65bf4fa59 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:19.944883 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f1287d7f-bfef-40a6-bd95-10c65bf4fa59 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:20.078832 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-f1287d7f-bfef-40a6-bd95-10c65bf4fa59 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:20.087929 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-f1287d7f-bfef-40a6-bd95-10c65bf4fa59 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee" status: 200 len: 1522 microversion: 2.1 time: 0.154839 Jun 22 10:23:20.087929 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 206/387] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:19 2022] GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:20.096251 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-d49fb735-3cad-4d5d-8973-f717f380111b tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:20.097567 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-d49fb735-3cad-4d5d-8973-f717f380111b tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 3cc6d1fb-02b4-411e-84a2-eb5a63344e0d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:20.104028 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d49fb735-3cad-4d5d-8973-f717f380111b tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:20.104469 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d49fb735-3cad-4d5d-8973-f717f380111b tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:20.105221 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d49fb735-3cad-4d5d-8973-f717f380111b tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:20.105646 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d49fb735-3cad-4d5d-8973-f717f380111b tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:20.239139 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-d49fb735-3cad-4d5d-8973-f717f380111b tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a394fc62e6a64a85b855bf2eb56b4b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a87feacfb84d6c9f7ea48f230753b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:20.248333 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-d49fb735-3cad-4d5d-8973-f717f380111b tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "GET /compute/v2.1/servers/3cc6d1fb-02b4-411e-84a2-eb5a63344e0d" status: 200 len: 1264 microversion: 2.1 time: 0.155727 Jun 22 10:23:20.249339 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 182/388] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:20 2022] GET /compute/v2.1/servers/3cc6d1fb-02b4-411e-84a2-eb5a63344e0d => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:20.323509 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-4f25cb71-0872-4599-a3e5-c1cee9202b7b tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:20.324224 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-4f25cb71-0872-4599-a3e5-c1cee9202b7b tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] [instance: 1236b62e-0b77-4a1e-8e13-86eb3aa55773] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:20.330798 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4f25cb71-0872-4599-a3e5-c1cee9202b7b tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:20.331405 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4f25cb71-0872-4599-a3e5-c1cee9202b7b tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:20.332345 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4f25cb71-0872-4599-a3e5-c1cee9202b7b tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:20.332888 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4f25cb71-0872-4599-a3e5-c1cee9202b7b tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:20.346933 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.wsgi [None req-4f25cb71-0872-4599-a3e5-c1cee9202b7b tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] HTTP exception thrown: Instance 1236b62e-0b77-4a1e-8e13-86eb3aa55773 could not be found. Jun 22 10:23:20.348695 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-4f25cb71-0872-4599-a3e5-c1cee9202b7b tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Request method failure captured: Jun 22 10:23:20.348695 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: request: GET /compute/v2.1/servers/1236b62e-0b77-4a1e-8e13-86eb3aa55773 HTTP/1.1 Jun 22 10:23:20.348695 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Accept: application/json Jun 22 10:23:20.348695 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Accept-Encoding: identity Jun 22 10:23:20.348695 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Connection: close Jun 22 10:23:20.348695 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Content-Length: 0 Jun 22 10:23:20.348695 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Content-Type: application/json Jun 22 10:23:20.348695 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Host: 10.222.0.66 Jun 22 10:23:20.348695 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Openstack-System-Scope: None Jun 22 10:23:20.348695 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: User-Agent: python-urllib3/1.26.9 Jun 22 10:23:20.348695 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Auth-Token: gAAAAABisu09ieeH2j3WICx8k1FgCC0aOp7L5bFQjtKIU620ed1N1owh0uQJRcnk59sS3Y71tMbY0hQlAOwK5Wgeuc-mBxM5JmSvYpq89jhW7U3VRrChGmdkRfmxLFdKo0tnJwIW60b3uC0mWOGDRPbHE06IR1Sl1P6kXpgqx7cPqIFOScQudTE Jun 22 10:23:20.348695 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Domain-Id: None Jun 22 10:23:20.348695 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Domain-Name: None Jun 22 10:23:20.348695 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Identity-Status: Confirmed Jun 22 10:23:20.348695 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Is-Admin-Project: True Jun 22 10:23:20.348695 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Domain-Id: default Jun 22 10:23:20.348695 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Domain-Name: Default Jun 22 10:23:20.348695 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Id: c5370eb5245247a68d7f224cdd457ea1 Jun 22 10:23:20.348695 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Name: tempest-VolumesActionsTest-298856248 Jun 22 10:23:20.348695 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Role: member,reader Jun 22 10:23:20.348695 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Roles: member,reader Jun 22 10:23:20.350242 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_c5370eb5245247a68d7f224cdd457ea1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c5370eb5245247a68d7f224cdd457ea1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/c5370eb5245247a68d7f224cdd457ea1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/c5370eb5245247a68d7f224cdd457ea1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}] Jun 22 10:23:20.350242 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant: tempest-VolumesActionsTest-298856248 Jun 22 10:23:20.350242 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant-Id: c5370eb5245247a68d7f224cdd457ea1 Jun 22 10:23:20.350242 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant-Name: tempest-VolumesActionsTest-298856248 Jun 22 10:23:20.350242 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User: tempest-VolumesActionsTest-298856248-project Jun 22 10:23:20.350242 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Domain-Id: default Jun 22 10:23:20.350242 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Domain-Name: Default Jun 22 10:23:20.350242 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Id: 0d1dcf4b8dbb4e1698e7b0c4dc9c63a4 Jun 22 10:23:20.350242 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Name: tempest-VolumesActionsTest-298856248-project Jun 22 10:23:20.350242 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: method: > Jun 22 10:23:20.350242 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: exception: Instance 1236b62e-0b77-4a1e-8e13-86eb3aa55773 could not be found. Jun 22 10:23:20.350242 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: action_args: {'id': '1236b62e-0b77-4a1e-8e13-86eb3aa55773'} Jun 22 10:23:20.351849 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:23:20.351849 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:23:20.351849 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:23:20.351849 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:23:20.351849 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:23:20.351849 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:23:20.351849 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:23:20.351849 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:23:20.351849 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:23:20.351849 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:23:20.351849 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1236b62e-0b77-4a1e-8e13-86eb3aa55773 could not be found. Jun 22 10:23:20.351849 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:23:20.351849 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:23:20.351849 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:23:20.351849 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:23:20.351849 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:23:20.351849 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:23:20.351849 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:23:20.351849 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:23:20.351849 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:23:20.353302 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:23:20.353302 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:23:20.353302 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:23:20.353302 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:23:20.353302 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:23:20.353302 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:23:20.353302 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:23:20.353302 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1236b62e-0b77-4a1e-8e13-86eb3aa55773 could not be found. Jun 22 10:23:20.353302 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:23:20.353302 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:23:20.353302 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:23:20.353302 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:23:20.353302 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:23:20.353302 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:23:20.353302 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:23:20.353302 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:23:20.353302 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1236b62e-0b77-4a1e-8e13-86eb3aa55773 could not be found. Jun 22 10:23:20.353302 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:23:20.354618 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-4f25cb71-0872-4599-a3e5-c1cee9202b7b tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] Returning 404 to user: Instance 1236b62e-0b77-4a1e-8e13-86eb3aa55773 could not be found. {{(pid=117680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:23:20.354618 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-4f25cb71-0872-4599-a3e5-c1cee9202b7b tempest-VolumesActionsTest-298856248 tempest-VolumesActionsTest-298856248-project] 10.222.0.66 "GET /compute/v2.1/servers/1236b62e-0b77-4a1e-8e13-86eb3aa55773" status: 404 len: 111 microversion: 2.1 time: 0.030574 Jun 22 10:23:20.354618 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 207/389] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:20 2022] GET /compute/v2.1/servers/1236b62e-0b77-4a1e-8e13-86eb3aa55773 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:23:21.105308 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-6e223cd1-fbe9-47c4-b331-f0251cb61259 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:21.106993 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-6e223cd1-fbe9-47c4-b331-f0251cb61259 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 739e9dbf-4ccc-4022-83e4-d2f4c36955ee] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:21.114774 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6e223cd1-fbe9-47c4-b331-f0251cb61259 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:21.115223 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6e223cd1-fbe9-47c4-b331-f0251cb61259 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:21.116062 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6e223cd1-fbe9-47c4-b331-f0251cb61259 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:21.116504 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6e223cd1-fbe9-47c4-b331-f0251cb61259 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:21.251829 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-6e223cd1-fbe9-47c4-b331-f0251cb61259 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:21.254256 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:21.261399 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-6e223cd1-fbe9-47c4-b331-f0251cb61259 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee" status: 200 len: 1522 microversion: 2.1 time: 0.161535 Jun 22 10:23:21.270701 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 183/390] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:21 2022] GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:21.270901 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-12d7db63-fbd5-4134-82fb-24c12de68fb5 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:21.270901 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-12d7db63-fbd5-4134-82fb-24c12de68fb5 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 3cc6d1fb-02b4-411e-84a2-eb5a63344e0d] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:21.272488 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-12d7db63-fbd5-4134-82fb-24c12de68fb5 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:21.272976 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-12d7db63-fbd5-4134-82fb-24c12de68fb5 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:21.273760 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-12d7db63-fbd5-4134-82fb-24c12de68fb5 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:21.274182 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-12d7db63-fbd5-4134-82fb-24c12de68fb5 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:21.425741 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-12d7db63-fbd5-4134-82fb-24c12de68fb5 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a394fc62e6a64a85b855bf2eb56b4b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a87feacfb84d6c9f7ea48f230753b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:21.433786 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-12d7db63-fbd5-4134-82fb-24c12de68fb5 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "GET /compute/v2.1/servers/3cc6d1fb-02b4-411e-84a2-eb5a63344e0d" status: 200 len: 1264 microversion: 2.1 time: 0.172385 Jun 22 10:23:21.434363 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 208/391] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:21 2022] GET /compute/v2.1/servers/3cc6d1fb-02b4-411e-84a2-eb5a63344e0d => generated 1264 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:23:22.279370 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-1b8e0139-8b1d-42a2-aca8-79392e5d9e4e tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:22.279964 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-1b8e0139-8b1d-42a2-aca8-79392e5d9e4e tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 739e9dbf-4ccc-4022-83e4-d2f4c36955ee] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:22.288661 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1b8e0139-8b1d-42a2-aca8-79392e5d9e4e tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:22.289153 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1b8e0139-8b1d-42a2-aca8-79392e5d9e4e tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:22.289920 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1b8e0139-8b1d-42a2-aca8-79392e5d9e4e tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:22.290366 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1b8e0139-8b1d-42a2-aca8-79392e5d9e4e tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:22.431756 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-1b8e0139-8b1d-42a2-aca8-79392e5d9e4e tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:22.439689 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-1b8e0139-8b1d-42a2-aca8-79392e5d9e4e tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee" status: 200 len: 1522 microversion: 2.1 time: 0.165000 Jun 22 10:23:22.440255 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 184/392] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:22 2022] GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:22.451559 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-62ce9971-3490-419d-8203-6c81bddae5b3 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:22.452289 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-62ce9971-3490-419d-8203-6c81bddae5b3 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 3cc6d1fb-02b4-411e-84a2-eb5a63344e0d] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:22.458751 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-62ce9971-3490-419d-8203-6c81bddae5b3 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:22.459433 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-62ce9971-3490-419d-8203-6c81bddae5b3 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:22.460206 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-62ce9971-3490-419d-8203-6c81bddae5b3 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:22.460866 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-62ce9971-3490-419d-8203-6c81bddae5b3 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:22.602324 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-62ce9971-3490-419d-8203-6c81bddae5b3 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a394fc62e6a64a85b855bf2eb56b4b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a87feacfb84d6c9f7ea48f230753b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:22.622143 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-62ce9971-3490-419d-8203-6c81bddae5b3 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "GET /compute/v2.1/servers/3cc6d1fb-02b4-411e-84a2-eb5a63344e0d" status: 200 len: 1264 microversion: 2.1 time: 0.174540 Jun 22 10:23:22.622814 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 209/393] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:22 2022] GET /compute/v2.1/servers/3cc6d1fb-02b4-411e-84a2-eb5a63344e0d => generated 1264 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:23.465035 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-a5a4738a-f7ba-42aa-9714-1489c2fcccf2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:23.465629 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-a5a4738a-f7ba-42aa-9714-1489c2fcccf2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 739e9dbf-4ccc-4022-83e4-d2f4c36955ee] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:23.468688 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_cell0:SELECT=2 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:23.469588 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_cell0:SELECT=6 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:23.474089 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a5a4738a-f7ba-42aa-9714-1489c2fcccf2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:23.474405 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a5a4738a-f7ba-42aa-9714-1489c2fcccf2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:23.475217 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a5a4738a-f7ba-42aa-9714-1489c2fcccf2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:23.475646 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a5a4738a-f7ba-42aa-9714-1489c2fcccf2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:23.639398 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-9e836ec3-94d8-4506-85df-ee358c10e0e2 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:23.640131 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-9e836ec3-94d8-4506-85df-ee358c10e0e2 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 3cc6d1fb-02b4-411e-84a2-eb5a63344e0d] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:23.643132 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell0:SELECT=2 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:23.647769 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9e836ec3-94d8-4506-85df-ee358c10e0e2 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:23.648573 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9e836ec3-94d8-4506-85df-ee358c10e0e2 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:23.649346 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9e836ec3-94d8-4506-85df-ee358c10e0e2 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:23.649775 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9e836ec3-94d8-4506-85df-ee358c10e0e2 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:23.667104 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-a5a4738a-f7ba-42aa-9714-1489c2fcccf2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:23.677177 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-a5a4738a-f7ba-42aa-9714-1489c2fcccf2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee" status: 200 len: 1522 microversion: 2.1 time: 0.215925 Jun 22 10:23:23.678031 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 185/394] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:23 2022] GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:23.793803 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-9e836ec3-94d8-4506-85df-ee358c10e0e2 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a394fc62e6a64a85b855bf2eb56b4b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a87feacfb84d6c9f7ea48f230753b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:23.802225 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-9e836ec3-94d8-4506-85df-ee358c10e0e2 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "GET /compute/v2.1/servers/3cc6d1fb-02b4-411e-84a2-eb5a63344e0d" status: 200 len: 1264 microversion: 2.1 time: 0.166918 Jun 22 10:23:23.802820 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 210/395] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:23 2022] GET /compute/v2.1/servers/3cc6d1fb-02b4-411e-84a2-eb5a63344e0d => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:24.694842 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-fd799cdb-bb5c-433b-9412-481e180cbf32 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:24.695549 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-fd799cdb-bb5c-433b-9412-481e180cbf32 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 739e9dbf-4ccc-4022-83e4-d2f4c36955ee] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:24.702364 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-fd799cdb-bb5c-433b-9412-481e180cbf32 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:24.702862 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-fd799cdb-bb5c-433b-9412-481e180cbf32 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:24.703616 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-fd799cdb-bb5c-433b-9412-481e180cbf32 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:24.704046 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-fd799cdb-bb5c-433b-9412-481e180cbf32 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:24.819433 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-6eb2b754-0349-4044-92de-a6f289ccd2db tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:24.820046 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-6eb2b754-0349-4044-92de-a6f289ccd2db tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 3cc6d1fb-02b4-411e-84a2-eb5a63344e0d] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:24.826212 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6eb2b754-0349-4044-92de-a6f289ccd2db tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:24.826699 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6eb2b754-0349-4044-92de-a6f289ccd2db tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:24.827479 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6eb2b754-0349-4044-92de-a6f289ccd2db tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:24.827916 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6eb2b754-0349-4044-92de-a6f289ccd2db tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:24.840173 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-fd799cdb-bb5c-433b-9412-481e180cbf32 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:24.855288 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-fd799cdb-bb5c-433b-9412-481e180cbf32 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee" status: 200 len: 1522 microversion: 2.1 time: 0.164351 Jun 22 10:23:24.855875 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 186/396] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:24 2022] GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:24.978143 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-6eb2b754-0349-4044-92de-a6f289ccd2db tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a394fc62e6a64a85b855bf2eb56b4b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a87feacfb84d6c9f7ea48f230753b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:24.986066 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-6eb2b754-0349-4044-92de-a6f289ccd2db tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "GET /compute/v2.1/servers/3cc6d1fb-02b4-411e-84a2-eb5a63344e0d" status: 200 len: 1264 microversion: 2.1 time: 0.170514 Jun 22 10:23:24.986680 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 211/397] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:24 2022] GET /compute/v2.1/servers/3cc6d1fb-02b4-411e-84a2-eb5a63344e0d => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:23:25.876093 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-81893701-b3a3-48c9-a829-89086f86008e tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:25.876777 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-81893701-b3a3-48c9-a829-89086f86008e tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 739e9dbf-4ccc-4022-83e4-d2f4c36955ee] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:25.885422 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-81893701-b3a3-48c9-a829-89086f86008e tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:25.885880 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-81893701-b3a3-48c9-a829-89086f86008e tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:25.886686 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-81893701-b3a3-48c9-a829-89086f86008e tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:25.887119 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-81893701-b3a3-48c9-a829-89086f86008e tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:26.004265 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-81f8af89-64a4-496d-af77-041645490ce4 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:26.004943 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-81f8af89-64a4-496d-af77-041645490ce4 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 3cc6d1fb-02b4-411e-84a2-eb5a63344e0d] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:26.011676 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-81f8af89-64a4-496d-af77-041645490ce4 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:26.012204 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-81f8af89-64a4-496d-af77-041645490ce4 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:26.013198 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-81f8af89-64a4-496d-af77-041645490ce4 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:26.013960 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-81f8af89-64a4-496d-af77-041645490ce4 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:26.025116 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-81893701-b3a3-48c9-a829-89086f86008e tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:26.033261 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-81893701-b3a3-48c9-a829-89086f86008e tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee" status: 200 len: 1522 microversion: 2.1 time: 0.163340 Jun 22 10:23:26.033842 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 187/398] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:25 2022] GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:23:26.157582 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-81f8af89-64a4-496d-af77-041645490ce4 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a394fc62e6a64a85b855bf2eb56b4b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a87feacfb84d6c9f7ea48f230753b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:26.165561 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-81f8af89-64a4-496d-af77-041645490ce4 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "GET /compute/v2.1/servers/3cc6d1fb-02b4-411e-84a2-eb5a63344e0d" status: 200 len: 1264 microversion: 2.1 time: 0.166716 Jun 22 10:23:26.166081 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 212/399] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:25 2022] GET /compute/v2.1/servers/3cc6d1fb-02b4-411e-84a2-eb5a63344e0d => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:23:27.050843 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-13c8c7d0-b6a7-4bbc-a55c-fbe4b691f336 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:27.051476 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-13c8c7d0-b6a7-4bbc-a55c-fbe4b691f336 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 739e9dbf-4ccc-4022-83e4-d2f4c36955ee] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:27.058529 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-13c8c7d0-b6a7-4bbc-a55c-fbe4b691f336 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:27.059009 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-13c8c7d0-b6a7-4bbc-a55c-fbe4b691f336 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:27.059742 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-13c8c7d0-b6a7-4bbc-a55c-fbe4b691f336 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:27.060221 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-13c8c7d0-b6a7-4bbc-a55c-fbe4b691f336 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:27.184555 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-bb4ff671-e967-4623-8d99-a8a0212cb5ce tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:27.185269 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-bb4ff671-e967-4623-8d99-a8a0212cb5ce tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 3cc6d1fb-02b4-411e-84a2-eb5a63344e0d] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:27.194689 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-bb4ff671-e967-4623-8d99-a8a0212cb5ce tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:27.195908 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-bb4ff671-e967-4623-8d99-a8a0212cb5ce tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:27.197651 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-bb4ff671-e967-4623-8d99-a8a0212cb5ce tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:27.198716 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-bb4ff671-e967-4623-8d99-a8a0212cb5ce tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:27.218492 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-13c8c7d0-b6a7-4bbc-a55c-fbe4b691f336 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:27.231084 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-13c8c7d0-b6a7-4bbc-a55c-fbe4b691f336 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee" status: 200 len: 1522 microversion: 2.1 time: 0.183851 Jun 22 10:23:27.231292 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:SELECT=100 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:27.232166 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 188/400] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:27 2022] GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:27.369074 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-bb4ff671-e967-4623-8d99-a8a0212cb5ce tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a394fc62e6a64a85b855bf2eb56b4b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a87feacfb84d6c9f7ea48f230753b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:27.376960 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-bb4ff671-e967-4623-8d99-a8a0212cb5ce tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "GET /compute/v2.1/servers/3cc6d1fb-02b4-411e-84a2-eb5a63344e0d" status: 200 len: 1264 microversion: 2.1 time: 0.197493 Jun 22 10:23:27.377564 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 213/401] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:27 2022] GET /compute/v2.1/servers/3cc6d1fb-02b4-411e-84a2-eb5a63344e0d => generated 1264 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:28.259725 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-1e12e11e-7501-455c-8eb7-8b7de3a3d5a1 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:28.261225 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-1e12e11e-7501-455c-8eb7-8b7de3a3d5a1 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 739e9dbf-4ccc-4022-83e4-d2f4c36955ee] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:28.269956 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1e12e11e-7501-455c-8eb7-8b7de3a3d5a1 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:28.270402 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1e12e11e-7501-455c-8eb7-8b7de3a3d5a1 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:28.271263 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1e12e11e-7501-455c-8eb7-8b7de3a3d5a1 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:28.271870 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1e12e11e-7501-455c-8eb7-8b7de3a3d5a1 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:28.395915 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-d91e2014-ec59-49b9-bdb7-4369e5d58895 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:28.397376 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-d91e2014-ec59-49b9-bdb7-4369e5d58895 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 3cc6d1fb-02b4-411e-84a2-eb5a63344e0d] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:28.409060 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d91e2014-ec59-49b9-bdb7-4369e5d58895 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:28.410383 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d91e2014-ec59-49b9-bdb7-4369e5d58895 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:28.412660 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d91e2014-ec59-49b9-bdb7-4369e5d58895 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:28.413779 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d91e2014-ec59-49b9-bdb7-4369e5d58895 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:28.431630 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-1e12e11e-7501-455c-8eb7-8b7de3a3d5a1 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:28.440145 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-1e12e11e-7501-455c-8eb7-8b7de3a3d5a1 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee" status: 200 len: 1522 microversion: 2.1 time: 0.189376 Jun 22 10:23:28.454490 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 189/402] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:28 2022] GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:28.612564 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-d91e2014-ec59-49b9-bdb7-4369e5d58895 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a394fc62e6a64a85b855bf2eb56b4b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a87feacfb84d6c9f7ea48f230753b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:28.621577 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-d91e2014-ec59-49b9-bdb7-4369e5d58895 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "GET /compute/v2.1/servers/3cc6d1fb-02b4-411e-84a2-eb5a63344e0d" status: 200 len: 1264 microversion: 2.1 time: 0.231860 Jun 22 10:23:28.622444 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 214/403] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:28 2022] GET /compute/v2.1/servers/3cc6d1fb-02b4-411e-84a2-eb5a63344e0d => generated 1264 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:29.463004 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-75c3dd6b-a6d2-4790-82c8-2c2d5414bb0d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:29.464576 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-75c3dd6b-a6d2-4790-82c8-2c2d5414bb0d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 739e9dbf-4ccc-4022-83e4-d2f4c36955ee] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:29.473408 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-75c3dd6b-a6d2-4790-82c8-2c2d5414bb0d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:29.474793 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-75c3dd6b-a6d2-4790-82c8-2c2d5414bb0d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:29.477817 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-75c3dd6b-a6d2-4790-82c8-2c2d5414bb0d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:29.478801 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-75c3dd6b-a6d2-4790-82c8-2c2d5414bb0d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:29.646523 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-56f8627c-4808-4322-a5c6-361965cf7dbc tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:29.646523 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-56f8627c-4808-4322-a5c6-361965cf7dbc tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 3cc6d1fb-02b4-411e-84a2-eb5a63344e0d] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:29.647113 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-75c3dd6b-a6d2-4790-82c8-2c2d5414bb0d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:29.651040 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-56f8627c-4808-4322-a5c6-361965cf7dbc tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:29.652240 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-56f8627c-4808-4322-a5c6-361965cf7dbc tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:29.653106 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-56f8627c-4808-4322-a5c6-361965cf7dbc tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:29.653758 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-56f8627c-4808-4322-a5c6-361965cf7dbc tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:29.656632 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-75c3dd6b-a6d2-4790-82c8-2c2d5414bb0d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee" status: 200 len: 1522 microversion: 2.1 time: 0.199112 Jun 22 10:23:29.666720 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 190/404] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:29 2022] GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:29.812641 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-56f8627c-4808-4322-a5c6-361965cf7dbc tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a394fc62e6a64a85b855bf2eb56b4b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a87feacfb84d6c9f7ea48f230753b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:29.821146 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-56f8627c-4808-4322-a5c6-361965cf7dbc tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "GET /compute/v2.1/servers/3cc6d1fb-02b4-411e-84a2-eb5a63344e0d" status: 200 len: 1264 microversion: 2.1 time: 0.183653 Jun 22 10:23:29.821721 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 215/405] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:29 2022] GET /compute/v2.1/servers/3cc6d1fb-02b4-411e-84a2-eb5a63344e0d => generated 1264 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:23:30.673950 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-534a19c5-e62d-4abe-b019-9ae34e823a65 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:30.675278 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-534a19c5-e62d-4abe-b019-9ae34e823a65 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 739e9dbf-4ccc-4022-83e4-d2f4c36955ee] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:30.681898 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:30.683474 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-534a19c5-e62d-4abe-b019-9ae34e823a65 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:30.684230 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-534a19c5-e62d-4abe-b019-9ae34e823a65 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:30.685250 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-534a19c5-e62d-4abe-b019-9ae34e823a65 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:30.686040 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-534a19c5-e62d-4abe-b019-9ae34e823a65 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:30.838454 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-7a52ce37-de6c-436e-ac7a-db1ead13af64 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:30.839110 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-7a52ce37-de6c-436e-ac7a-db1ead13af64 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 3cc6d1fb-02b4-411e-84a2-eb5a63344e0d] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:30.844538 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-534a19c5-e62d-4abe-b019-9ae34e823a65 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:30.845504 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7a52ce37-de6c-436e-ac7a-db1ead13af64 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:30.846219 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7a52ce37-de6c-436e-ac7a-db1ead13af64 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:30.847031 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7a52ce37-de6c-436e-ac7a-db1ead13af64 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:30.847462 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7a52ce37-de6c-436e-ac7a-db1ead13af64 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:30.853644 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-534a19c5-e62d-4abe-b019-9ae34e823a65 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee" status: 200 len: 1502 microversion: 2.1 time: 0.183500 Jun 22 10:23:30.867463 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 191/406] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:30 2022] GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee => generated 1502 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:30.878566 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-a0995d83-b731-498c-8847-57f48bf66332 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bab65e57-958d-47d0-bb9f-f3a582d3860f"}} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:23:30.893053 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-a0995d83-b731-498c-8847-57f48bf66332 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 739e9dbf-4ccc-4022-83e4-d2f4c36955ee] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:30.899025 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a0995d83-b731-498c-8847-57f48bf66332 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:30.899557 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a0995d83-b731-498c-8847-57f48bf66332 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:30.900459 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a0995d83-b731-498c-8847-57f48bf66332 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:30.901041 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a0995d83-b731-498c-8847-57f48bf66332 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:30.928486 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.wsgi [None req-a0995d83-b731-498c-8847-57f48bf66332 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] HTTP exception thrown: Cannot 'attach_volume' instance 739e9dbf-4ccc-4022-83e4-d2f4c36955ee while it is in vm_state rescued Jun 22 10:23:30.931112 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-a0995d83-b731-498c-8847-57f48bf66332 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Request method failure captured: Jun 22 10:23:30.931112 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: request: POST /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee/os-volume_attachments HTTP/1.1 Jun 22 10:23:30.931112 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Accept: application/json Jun 22 10:23:30.931112 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Accept-Encoding: identity Jun 22 10:23:30.931112 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Connection: close Jun 22 10:23:30.931112 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Content-Length: 74 Jun 22 10:23:30.931112 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Content-Type: application/json Jun 22 10:23:30.931112 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Host: 10.222.0.66 Jun 22 10:23:30.931112 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Openstack-System-Scope: None Jun 22 10:23:30.931112 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: User-Agent: python-urllib3/1.26.9 Jun 22 10:23:30.931112 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Auth-Token: gAAAAABisu0KTX4LByDrs2wd0wf7QkjgZCYL58jTaGKxU6GloV6S5vTA8f4YmIXgHT_KMAgKu1jdsn-8Uga7Qnln7YVuKutNjZ4Xn3tAFNoo7zG8SK5VuNoRcwHUn_V5P08hyf2Bosoz8F0t6BB7YpwwfdbxZ3fftIbWEfVknGZuJ2vKr7E2QFU Jun 22 10:23:30.931112 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Domain-Id: None Jun 22 10:23:30.931112 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Domain-Name: None Jun 22 10:23:30.931112 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Identity-Status: Confirmed Jun 22 10:23:30.931112 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Is-Admin-Project: True Jun 22 10:23:30.931112 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Domain-Id: default Jun 22 10:23:30.931112 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Domain-Name: Default Jun 22 10:23:30.931112 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Id: f20791fa785649cfa5df1f60df84dbdb Jun 22 10:23:30.931112 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2082763206 Jun 22 10:23:30.931112 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Role: member,reader Jun 22 10:23:30.931112 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Roles: member,reader Jun 22 10:23:30.932732 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f20791fa785649cfa5df1f60df84dbdb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f20791fa785649cfa5df1f60df84dbdb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f20791fa785649cfa5df1f60df84dbdb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f20791fa785649cfa5df1f60df84dbdb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}] Jun 22 10:23:30.932732 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2082763206 Jun 22 10:23:30.932732 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Tenant-Id: f20791fa785649cfa5df1f60df84dbdb Jun 22 10:23:30.932732 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2082763206 Jun 22 10:23:30.932732 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User: tempest-ServerRescueNegativeTestJSON-2082763206-project Jun 22 10:23:30.932732 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Domain-Id: default Jun 22 10:23:30.932732 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Domain-Name: Default Jun 22 10:23:30.932732 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Id: 8fc916f852f4433eac4a3a2a12384834 Jun 22 10:23:30.932732 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2082763206-project Jun 22 10:23:30.932732 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Jun 22 10:23:30.932732 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: {"volumeAttachment": {"volumeId": "bab65e57-958d-47d0-bb9f-f3a582d3860f"}} Jun 22 10:23:30.932732 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: method: > Jun 22 10:23:30.933831 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: exception: Cannot 'attach_volume' instance 739e9dbf-4ccc-4022-83e4-d2f4c36955ee while it is in vm_state rescued Jun 22 10:23:30.933831 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: action_args: {'server_id': '739e9dbf-4ccc-4022-83e4-d2f4c36955ee', 'body': {'volumeAttachment': {'volumeId': 'bab65e57-958d-47d0-bb9f-f3a582d3860f'}}} Jun 22 10:23:30.933831 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:23:30.933831 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:23:30.933831 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 22 10:23:30.933831 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 22 10:23:30.933831 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 22 10:23:30.933831 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 22 10:23:30.933831 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 22 10:23:30.933831 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 22 10:23:30.933831 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 739e9dbf-4ccc-4022-83e4-d2f4c36955ee in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 22 10:23:30.933831 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:23:30.933831 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:23:30.933831 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:23:30.933831 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:23:30.933831 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:23:30.933831 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:23:30.933831 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:23:30.933831 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:23:30.935379 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:23:30.935379 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:23:30.935379 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 10:23:30.935379 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 10:23:30.935379 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 10:23:30.935379 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 10:23:30.935379 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 10:23:30.935379 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 10:23:30.935379 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 22 10:23:30.935379 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 22 10:23:30.935379 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 22 10:23:30.935379 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 22 10:23:30.935379 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 739e9dbf-4ccc-4022-83e4-d2f4c36955ee while it is in vm_state rescued Jun 22 10:23:30.935379 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:23:30.935379 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:23:30.935379 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:23:30.935379 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:23:30.935379 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:23:30.935379 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:23:30.936754 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:23:30.936754 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:23:30.936754 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 739e9dbf-4ccc-4022-83e4-d2f4c36955ee while it is in vm_state rescued Jun 22 10:23:30.936754 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:23:30.936754 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-a0995d83-b731-498c-8847-57f48bf66332 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Returning 409 to user: Cannot 'attach_volume' instance 739e9dbf-4ccc-4022-83e4-d2f4c36955ee while it is in vm_state rescued {{(pid=117679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:23:30.936754 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-a0995d83-b731-498c-8847-57f48bf66332 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "POST /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.058900 Jun 22 10:23:30.937350 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 192/407] 10.222.0.66 () {60 vars in 1322 bytes} [Wed Jun 22 10:23:30 2022] POST /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee/os-volume_attachments => generated 152 bytes in 64 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jun 22 10:23:30.946142 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-2b45732c-c0d3-4ad5-9803-2cb49a77ee27 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:23:30.946839 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-2b45732c-c0d3-4ad5-9803-2cb49a77ee27 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 739e9dbf-4ccc-4022-83e4-d2f4c36955ee] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:30.955696 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2b45732c-c0d3-4ad5-9803-2cb49a77ee27 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:30.956409 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2b45732c-c0d3-4ad5-9803-2cb49a77ee27 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:30.957353 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2b45732c-c0d3-4ad5-9803-2cb49a77ee27 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:30.958092 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2b45732c-c0d3-4ad5-9803-2cb49a77ee27 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:31.054244 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-7a52ce37-de6c-436e-ac7a-db1ead13af64 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a394fc62e6a64a85b855bf2eb56b4b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a87feacfb84d6c9f7ea48f230753b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:31.069559 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-7a52ce37-de6c-436e-ac7a-db1ead13af64 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "GET /compute/v2.1/servers/3cc6d1fb-02b4-411e-84a2-eb5a63344e0d" status: 200 len: 1264 microversion: 2.1 time: 0.235532 Jun 22 10:23:31.070477 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 216/408] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:30 2022] GET /compute/v2.1/servers/3cc6d1fb-02b4-411e-84a2-eb5a63344e0d => generated 1264 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:23:31.070669 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-2b45732c-c0d3-4ad5-9803-2cb49a77ee27 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "POST /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee/action" status: 202 len: 0 microversion: 2.1 time: 0.127588 Jun 22 10:23:31.074864 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 193/409] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Jun 22 10:23:30 2022] POST /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:23:31.082894 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-4f4d9648-93f3-44c5-9a6a-c7899de3c407 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:31.095721 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-4f4d9648-93f3-44c5-9a6a-c7899de3c407 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 739e9dbf-4ccc-4022-83e4-d2f4c36955ee] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:31.107072 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4f4d9648-93f3-44c5-9a6a-c7899de3c407 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:31.107900 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4f4d9648-93f3-44c5-9a6a-c7899de3c407 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:31.108967 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4f4d9648-93f3-44c5-9a6a-c7899de3c407 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:31.109677 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4f4d9648-93f3-44c5-9a6a-c7899de3c407 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:31.554225 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-c41a0cbe-09a7-4bde-bcda-eeecfe59a1c3 req-79c9a38d-6115-4af7-afb2-4e2fb89f1732 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cc6d1fb-02b4-411e-84a2-eb5a63344e0d", "name": "network-vif-plugged", "status": "completed", "tag": "929e1349-8efe-439a-9035-3dbc4bc6c6a8"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:23:31.566591 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-c41a0cbe-09a7-4bde-bcda-eeecfe59a1c3 req-79c9a38d-6115-4af7-afb2-4e2fb89f1732 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:31.567226 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-c41a0cbe-09a7-4bde-bcda-eeecfe59a1c3 req-79c9a38d-6115-4af7-afb2-4e2fb89f1732 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:31.592404 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-c41a0cbe-09a7-4bde-bcda-eeecfe59a1c3 req-79c9a38d-6115-4af7-afb2-4e2fb89f1732 service nova] Creating event network-vif-plugged:929e1349-8efe-439a-9035-3dbc4bc6c6a8 for instance 3cc6d1fb-02b4-411e-84a2-eb5a63344e0d on hv-cinder-84713 Jun 22 10:23:31.607413 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-c41a0cbe-09a7-4bde-bcda-eeecfe59a1c3 req-79c9a38d-6115-4af7-afb2-4e2fb89f1732 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059160 Jun 22 10:23:31.609135 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 194/410] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:23:31.674970 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-4f4d9648-93f3-44c5-9a6a-c7899de3c407 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:31.683260 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-4f4d9648-93f3-44c5-9a6a-c7899de3c407 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee" status: 200 len: 1510 microversion: 2.1 time: 0.606460 Jun 22 10:23:31.683775 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 217/411] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:31 2022] GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee => generated 1510 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:32.097360 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-160c5f43-2deb-4d45-b136-9b589ff38bf5 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:32.098651 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-160c5f43-2deb-4d45-b136-9b589ff38bf5 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 3cc6d1fb-02b4-411e-84a2-eb5a63344e0d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:32.120392 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-160c5f43-2deb-4d45-b136-9b589ff38bf5 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:32.128865 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-160c5f43-2deb-4d45-b136-9b589ff38bf5 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:32.135160 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-160c5f43-2deb-4d45-b136-9b589ff38bf5 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:32.136196 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-160c5f43-2deb-4d45-b136-9b589ff38bf5 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:32.321900 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-160c5f43-2deb-4d45-b136-9b589ff38bf5 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a394fc62e6a64a85b855bf2eb56b4b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a87feacfb84d6c9f7ea48f230753b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:32.330224 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-160c5f43-2deb-4d45-b136-9b589ff38bf5 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "GET /compute/v2.1/servers/3cc6d1fb-02b4-411e-84a2-eb5a63344e0d" status: 200 len: 1264 microversion: 2.1 time: 0.245540 Jun 22 10:23:32.331120 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 195/412] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:32 2022] GET /compute/v2.1/servers/3cc6d1fb-02b4-411e-84a2-eb5a63344e0d => generated 1264 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:23:32.702422 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-a2969d26-98a0-4c7e-ae7d-40e85e6cb483 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:32.703050 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-a2969d26-98a0-4c7e-ae7d-40e85e6cb483 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 739e9dbf-4ccc-4022-83e4-d2f4c36955ee] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:32.709620 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a2969d26-98a0-4c7e-ae7d-40e85e6cb483 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:32.710339 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a2969d26-98a0-4c7e-ae7d-40e85e6cb483 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:32.711242 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a2969d26-98a0-4c7e-ae7d-40e85e6cb483 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:32.711872 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a2969d26-98a0-4c7e-ae7d-40e85e6cb483 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:32.891650 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-a2969d26-98a0-4c7e-ae7d-40e85e6cb483 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:32.899700 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-a2969d26-98a0-4c7e-ae7d-40e85e6cb483 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee" status: 200 len: 1510 microversion: 2.1 time: 0.201093 Jun 22 10:23:32.900371 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 218/413] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:32 2022] GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee => generated 1510 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:33.346948 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-2d7e285b-405c-4f23-a15d-f1977b076390 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:33.347499 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-2d7e285b-405c-4f23-a15d-f1977b076390 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 3cc6d1fb-02b4-411e-84a2-eb5a63344e0d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:33.356094 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2d7e285b-405c-4f23-a15d-f1977b076390 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:33.356591 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2d7e285b-405c-4f23-a15d-f1977b076390 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:33.357367 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2d7e285b-405c-4f23-a15d-f1977b076390 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:33.357782 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2d7e285b-405c-4f23-a15d-f1977b076390 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:33.531090 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-2d7e285b-405c-4f23-a15d-f1977b076390 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a394fc62e6a64a85b855bf2eb56b4b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a87feacfb84d6c9f7ea48f230753b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:33.539710 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-2d7e285b-405c-4f23-a15d-f1977b076390 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "GET /compute/v2.1/servers/3cc6d1fb-02b4-411e-84a2-eb5a63344e0d" status: 200 len: 1264 microversion: 2.1 time: 0.196725 Jun 22 10:23:33.540686 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 196/414] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:33 2022] GET /compute/v2.1/servers/3cc6d1fb-02b4-411e-84a2-eb5a63344e0d => generated 1264 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:33.920338 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-4a29a3d1-55f3-4d1d-9512-d9b02f0b900e tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:33.920895 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-4a29a3d1-55f3-4d1d-9512-d9b02f0b900e tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 739e9dbf-4ccc-4022-83e4-d2f4c36955ee] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:33.923380 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_api:SELECT=70 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:33.930853 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4a29a3d1-55f3-4d1d-9512-d9b02f0b900e tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:33.931555 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4a29a3d1-55f3-4d1d-9512-d9b02f0b900e tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:33.932343 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4a29a3d1-55f3-4d1d-9512-d9b02f0b900e tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:33.933092 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4a29a3d1-55f3-4d1d-9512-d9b02f0b900e tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:34.084136 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-4a29a3d1-55f3-4d1d-9512-d9b02f0b900e tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:34.093216 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-4a29a3d1-55f3-4d1d-9512-d9b02f0b900e tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee" status: 200 len: 1510 microversion: 2.1 time: 0.177635 Jun 22 10:23:34.094132 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 219/415] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:33 2022] GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee => generated 1510 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:34.556944 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-628e1eed-7b90-4e8f-a97e-3d37702255a3 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:34.558254 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-628e1eed-7b90-4e8f-a97e-3d37702255a3 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 3cc6d1fb-02b4-411e-84a2-eb5a63344e0d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:34.565355 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-628e1eed-7b90-4e8f-a97e-3d37702255a3 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:34.565800 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-628e1eed-7b90-4e8f-a97e-3d37702255a3 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:34.566657 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-628e1eed-7b90-4e8f-a97e-3d37702255a3 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:34.567059 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-628e1eed-7b90-4e8f-a97e-3d37702255a3 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:34.714063 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-628e1eed-7b90-4e8f-a97e-3d37702255a3 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a394fc62e6a64a85b855bf2eb56b4b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a87feacfb84d6c9f7ea48f230753b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:34.722370 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-628e1eed-7b90-4e8f-a97e-3d37702255a3 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "GET /compute/v2.1/servers/3cc6d1fb-02b4-411e-84a2-eb5a63344e0d" status: 200 len: 1264 microversion: 2.1 time: 0.169304 Jun 22 10:23:34.722969 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 197/416] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:34 2022] GET /compute/v2.1/servers/3cc6d1fb-02b4-411e-84a2-eb5a63344e0d => generated 1264 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:35.125890 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-82f5e47b-d5e8-429d-8f48-1ea56746059c tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:35.126495 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-82f5e47b-d5e8-429d-8f48-1ea56746059c tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 739e9dbf-4ccc-4022-83e4-d2f4c36955ee] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:35.133034 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-82f5e47b-d5e8-429d-8f48-1ea56746059c tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:35.133487 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-82f5e47b-d5e8-429d-8f48-1ea56746059c tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:35.134266 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-82f5e47b-d5e8-429d-8f48-1ea56746059c tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:35.134730 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-82f5e47b-d5e8-429d-8f48-1ea56746059c tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:35.297608 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-82f5e47b-d5e8-429d-8f48-1ea56746059c tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:35.310073 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-82f5e47b-d5e8-429d-8f48-1ea56746059c tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee" status: 200 len: 1510 microversion: 2.1 time: 0.198728 Jun 22 10:23:35.311206 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 220/417] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:35 2022] GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee => generated 1510 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:35.738681 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-49aa83a1-de9f-4748-8bde-913a045926fa tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:35.741458 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-49aa83a1-de9f-4748-8bde-913a045926fa tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 3cc6d1fb-02b4-411e-84a2-eb5a63344e0d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:35.750294 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-49aa83a1-de9f-4748-8bde-913a045926fa tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:35.750822 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-49aa83a1-de9f-4748-8bde-913a045926fa tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:35.751660 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-49aa83a1-de9f-4748-8bde-913a045926fa tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:35.752433 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-49aa83a1-de9f-4748-8bde-913a045926fa tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:35.920653 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-49aa83a1-de9f-4748-8bde-913a045926fa tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a394fc62e6a64a85b855bf2eb56b4b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a87feacfb84d6c9f7ea48f230753b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:35.931709 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-49aa83a1-de9f-4748-8bde-913a045926fa tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "GET /compute/v2.1/servers/3cc6d1fb-02b4-411e-84a2-eb5a63344e0d" status: 200 len: 1264 microversion: 2.1 time: 0.196290 Jun 22 10:23:35.942173 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 198/418] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:35 2022] GET /compute/v2.1/servers/3cc6d1fb-02b4-411e-84a2-eb5a63344e0d => generated 1264 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:36.328174 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-eeac74b7-69dd-425c-9fa9-78f71fdb83e9 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:36.329254 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-eeac74b7-69dd-425c-9fa9-78f71fdb83e9 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 739e9dbf-4ccc-4022-83e4-d2f4c36955ee] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:36.336695 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-eeac74b7-69dd-425c-9fa9-78f71fdb83e9 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:36.337642 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-eeac74b7-69dd-425c-9fa9-78f71fdb83e9 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:36.338540 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-eeac74b7-69dd-425c-9fa9-78f71fdb83e9 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:36.339247 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-eeac74b7-69dd-425c-9fa9-78f71fdb83e9 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:36.492375 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-eeac74b7-69dd-425c-9fa9-78f71fdb83e9 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:36.500701 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-eeac74b7-69dd-425c-9fa9-78f71fdb83e9 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee" status: 200 len: 1510 microversion: 2.1 time: 0.177119 Jun 22 10:23:36.501400 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 221/419] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:36 2022] GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee => generated 1510 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:36.949351 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-e5e61420-d99d-4e56-a900-4cc92227f7e7 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:36.950152 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-e5e61420-d99d-4e56-a900-4cc92227f7e7 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 3cc6d1fb-02b4-411e-84a2-eb5a63344e0d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:36.957322 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e5e61420-d99d-4e56-a900-4cc92227f7e7 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:36.957805 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e5e61420-d99d-4e56-a900-4cc92227f7e7 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:36.959263 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e5e61420-d99d-4e56-a900-4cc92227f7e7 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:36.960021 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e5e61420-d99d-4e56-a900-4cc92227f7e7 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:37.130562 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-e5e61420-d99d-4e56-a900-4cc92227f7e7 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a394fc62e6a64a85b855bf2eb56b4b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a87feacfb84d6c9f7ea48f230753b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:37.140168 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-e5e61420-d99d-4e56-a900-4cc92227f7e7 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "GET /compute/v2.1/servers/3cc6d1fb-02b4-411e-84a2-eb5a63344e0d" status: 200 len: 1452 microversion: 2.1 time: 0.194633 Jun 22 10:23:37.140752 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 199/420] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:36 2022] GET /compute/v2.1/servers/3cc6d1fb-02b4-411e-84a2-eb5a63344e0d => generated 1452 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:37.159099 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-5e03cb17-667d-419f-85dc-9a9de317d07c tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:37.159933 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-5e03cb17-667d-419f-85dc-9a9de317d07c tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 3cc6d1fb-02b4-411e-84a2-eb5a63344e0d] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:37.167366 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5e03cb17-667d-419f-85dc-9a9de317d07c tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:37.167882 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5e03cb17-667d-419f-85dc-9a9de317d07c tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:37.168811 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5e03cb17-667d-419f-85dc-9a9de317d07c tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:37.169376 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5e03cb17-667d-419f-85dc-9a9de317d07c tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:37.324739 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-5e03cb17-667d-419f-85dc-9a9de317d07c tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a394fc62e6a64a85b855bf2eb56b4b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a87feacfb84d6c9f7ea48f230753b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:37.332438 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-5e03cb17-667d-419f-85dc-9a9de317d07c tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "GET /compute/v2.1/servers/3cc6d1fb-02b4-411e-84a2-eb5a63344e0d" status: 200 len: 1452 microversion: 2.1 time: 0.178095 Jun 22 10:23:37.333112 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 222/421] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:37 2022] GET /compute/v2.1/servers/3cc6d1fb-02b4-411e-84a2-eb5a63344e0d => generated 1452 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:23:37.519429 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-6ac9b7ce-68bd-4b76-bcd5-3813c6cd1c79 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:37.520431 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-6ac9b7ce-68bd-4b76-bcd5-3813c6cd1c79 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 739e9dbf-4ccc-4022-83e4-d2f4c36955ee] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:37.531205 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6ac9b7ce-68bd-4b76-bcd5-3813c6cd1c79 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:37.532694 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6ac9b7ce-68bd-4b76-bcd5-3813c6cd1c79 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:37.533913 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6ac9b7ce-68bd-4b76-bcd5-3813c6cd1c79 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:37.535371 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6ac9b7ce-68bd-4b76-bcd5-3813c6cd1c79 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:37.570710 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:37.704573 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-6ac9b7ce-68bd-4b76-bcd5-3813c6cd1c79 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:37.713102 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-6ac9b7ce-68bd-4b76-bcd5-3813c6cd1c79 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee" status: 200 len: 1516 microversion: 2.1 time: 0.197578 Jun 22 10:23:37.714122 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 200/422] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:37 2022] GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee => generated 1516 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:39.888446 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-8e514b58-25a7-44ed-81ab-9b35e27912eb req-229229d7-8436-45f5-ac8a-0bdcc85b3ec5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cc6d1fb-02b4-411e-84a2-eb5a63344e0d", "tag": "929e1349-8efe-439a-9035-3dbc4bc6c6a8"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:23:39.903938 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-8e514b58-25a7-44ed-81ab-9b35e27912eb req-229229d7-8436-45f5-ac8a-0bdcc85b3ec5 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:39.905828 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-8e514b58-25a7-44ed-81ab-9b35e27912eb req-229229d7-8436-45f5-ac8a-0bdcc85b3ec5 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:39.919255 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-8e514b58-25a7-44ed-81ab-9b35e27912eb req-229229d7-8436-45f5-ac8a-0bdcc85b3ec5 service nova] Creating event network-changed:929e1349-8efe-439a-9035-3dbc4bc6c6a8 for instance 3cc6d1fb-02b4-411e-84a2-eb5a63344e0d on hv-cinder-84713 Jun 22 10:23:39.926284 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-8e514b58-25a7-44ed-81ab-9b35e27912eb req-229229d7-8436-45f5-ac8a-0bdcc85b3ec5 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040925 Jun 22 10:23:39.927461 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 223/423] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:23:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:23:40.372971 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-90f6121c-c658-4dc9-9104-c871e8fbce02 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Action: 'create', calling method: .version_select at 0x7f60da147ca0>, body: {"keypair": {"name": "tempest-keypair-2038482948", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2mcpmcS1z382qR61sRT7sMXEoT58zktnZDU3juE9LiaPSkP3/A9G75hTJa5er3tO9MKPem+gPn+RV5WfqLSjgHme4pZUVNI7tr7QfCBaqTJXv0zM0LVHDLe5twgUTm7A=="}} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:23:40.412123 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.quota [None req-90f6121c-c658-4dc9-9104-c871e8fbce02 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Getting quotas for project f20791fa785649cfa5df1f60df84dbdb. Resources: {'key_pairs'} {{(pid=117679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:23:40.417050 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.quota [None req-90f6121c-c658-4dc9-9104-c871e8fbce02 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Getting quotas for user 8fc916f852f4433eac4a3a2a12384834 and project f20791fa785649cfa5df1f60df84dbdb. Resources: {'key_pairs'} {{(pid=117679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:23:40.473277 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-90f6121c-c658-4dc9-9104-c871e8fbce02 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.103460 Jun 22 10:23:40.474199 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 201/424] 10.222.0.66 () {60 vars in 1158 bytes} [Wed Jun 22 10:23:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:23:42.346269 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-8000b415-6778-4520-b518-093710086fb4 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-711330072", "imageRef": "58addf50-5317-403a-beb0-4760bdbcaa13", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3f9e3af6-d8e5-4494-8a6f-1fa18789963f"}], "security_groups": [{"name": "tempest-securitygroup--695114261"}], "key_name": "tempest-keypair-2038482948", "user_data": "}} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:23:42.452456 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.network.neutron [None req-8000b415-6778-4520-b518-093710086fb4 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] validate_networks() for [('3f9e3af6-d8e5-4494-8a6f-1fa18789963f', None, None, None, None, None)] {{(pid=117680) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 10:23:42.920700 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-8000b415-6778-4520-b518-093710086fb4 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Flavor limits 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 10:23:42.921128 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-8000b415-6778-4520-b518-093710086fb4 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Image limits 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 10:23:42.921596 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-8000b415-6778-4520-b518-093710086fb4 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Flavor pref 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 10:23:42.921997 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-8000b415-6778-4520-b518-093710086fb4 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Image pref 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 10:23:42.922401 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-8000b415-6778-4520-b518-093710086fb4 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 10:23:42.933124 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8000b415-6778-4520-b518-093710086fb4 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:42.933556 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8000b415-6778-4520-b518-093710086fb4 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:42.934422 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8000b415-6778-4520-b518-093710086fb4 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:42.934793 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8000b415-6778-4520-b518-093710086fb4 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:42.951777 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.quota [None req-8000b415-6778-4520-b518-093710086fb4 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Getting quotas for project f20791fa785649cfa5df1f60df84dbdb. Resources: {'instances', 'cores', 'ram'} {{(pid=117680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:23:42.955888 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.quota [None req-8000b415-6778-4520-b518-093710086fb4 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Getting quotas for user 8fc916f852f4433eac4a3a2a12384834 and project f20791fa785649cfa5df1f60df84dbdb. Resources: {'instances', 'cores', 'ram'} {{(pid=117680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:23:42.972582 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-8000b415-6778-4520-b518-093710086fb4 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Going to run 1 instances... {{(pid=117680) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 10:23:42.975160 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-8000b415-6778-4520-b518-093710086fb4 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 156c832e-e672-428f-9404-1e2964ae5609] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58addf50-5317-403a-beb0-4760bdbcaa13',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 10:23:43.045064 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-8000b415-6778-4520-b518-093710086fb4 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.704133 Jun 22 10:23:43.045632 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 224/425] 10.222.0.66 () {60 vars in 1146 bytes} [Wed Jun 22 10:23:42 2022] POST /compute/v2.1/servers => generated 408 bytes in 706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 10:23:43.063849 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-7fbf5df0-c06a-490a-8b81-9a93b5a61947 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:43.065310 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-7fbf5df0-c06a-490a-8b81-9a93b5a61947 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 156c832e-e672-428f-9404-1e2964ae5609] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:43.138437 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-7fbf5df0-c06a-490a-8b81-9a93b5a61947 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:43.146194 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-7fbf5df0-c06a-490a-8b81-9a93b5a61947 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609" status: 200 len: 1245 microversion: 2.1 time: 0.094005 Jun 22 10:23:43.147097 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 202/426] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:43 2022] GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609 => generated 1245 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:44.174782 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-668d076d-3b73-426a-870e-3cceae20774a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:44.178683 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-668d076d-3b73-426a-870e-3cceae20774a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 156c832e-e672-428f-9404-1e2964ae5609] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:44.196785 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-668d076d-3b73-426a-870e-3cceae20774a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:44.198425 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-668d076d-3b73-426a-870e-3cceae20774a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:44.200291 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-668d076d-3b73-426a-870e-3cceae20774a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:44.202776 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-668d076d-3b73-426a-870e-3cceae20774a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:44.331888 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-668d076d-3b73-426a-870e-3cceae20774a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:44.356747 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-668d076d-3b73-426a-870e-3cceae20774a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609" status: 200 len: 1305 microversion: 2.1 time: 0.192867 Jun 22 10:23:44.358740 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 225/427] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:44 2022] GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609 => generated 1305 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:45.380425 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-e0ef24ff-a814-4ac5-b4fc-750af103865a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:45.382060 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-e0ef24ff-a814-4ac5-b4fc-750af103865a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 156c832e-e672-428f-9404-1e2964ae5609] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:45.397218 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e0ef24ff-a814-4ac5-b4fc-750af103865a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:45.397962 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e0ef24ff-a814-4ac5-b4fc-750af103865a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:45.399027 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e0ef24ff-a814-4ac5-b4fc-750af103865a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:45.399622 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e0ef24ff-a814-4ac5-b4fc-750af103865a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:45.593625 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-e0ef24ff-a814-4ac5-b4fc-750af103865a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:45.604911 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-e0ef24ff-a814-4ac5-b4fc-750af103865a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609" status: 200 len: 1370 microversion: 2.1 time: 0.231049 Jun 22 10:23:45.618303 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 203/428] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:45 2022] GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609 => generated 1370 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:23:46.184934 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-0b1f474b-73e2-493c-86ca-1f7fd4ce1abd req-c363a37e-4362-4c14-b7e0-4ca9bade6056 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "156c832e-e672-428f-9404-1e2964ae5609", "tag": "d5a527b2-317f-467a-b39d-b955e3a5dea6"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:23:46.215262 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-0b1f474b-73e2-493c-86ca-1f7fd4ce1abd req-c363a37e-4362-4c14-b7e0-4ca9bade6056 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:46.215998 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-0b1f474b-73e2-493c-86ca-1f7fd4ce1abd req-c363a37e-4362-4c14-b7e0-4ca9bade6056 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:46.233878 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-0b1f474b-73e2-493c-86ca-1f7fd4ce1abd req-c363a37e-4362-4c14-b7e0-4ca9bade6056 service nova] Creating event network-changed:d5a527b2-317f-467a-b39d-b955e3a5dea6 for instance 156c832e-e672-428f-9404-1e2964ae5609 on hv-cinder-84713 Jun 22 10:23:46.240071 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-0b1f474b-73e2-493c-86ca-1f7fd4ce1abd req-c363a37e-4362-4c14-b7e0-4ca9bade6056 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060924 Jun 22 10:23:46.246783 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 226/429] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:23:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:23:46.628803 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-21a810b8-adfd-4f4a-893b-d9b0044ce020 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:46.629616 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-21a810b8-adfd-4f4a-893b-d9b0044ce020 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 156c832e-e672-428f-9404-1e2964ae5609] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:46.645416 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-21a810b8-adfd-4f4a-893b-d9b0044ce020 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:46.646334 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-21a810b8-adfd-4f4a-893b-d9b0044ce020 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:46.647700 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-21a810b8-adfd-4f4a-893b-d9b0044ce020 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:46.648258 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-21a810b8-adfd-4f4a-893b-d9b0044ce020 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:46.847609 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-21a810b8-adfd-4f4a-893b-d9b0044ce020 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:46.856873 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-21a810b8-adfd-4f4a-893b-d9b0044ce020 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609" status: 200 len: 1370 microversion: 2.1 time: 0.232553 Jun 22 10:23:46.858005 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 204/430] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:46 2022] GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609 => generated 1370 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:23:47.875309 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-8556ae6e-edad-40bb-aae9-c7ba7e9dac06 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:47.875993 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-8556ae6e-edad-40bb-aae9-c7ba7e9dac06 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 156c832e-e672-428f-9404-1e2964ae5609] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:47.882997 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8556ae6e-edad-40bb-aae9-c7ba7e9dac06 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:47.883487 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8556ae6e-edad-40bb-aae9-c7ba7e9dac06 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:47.884277 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8556ae6e-edad-40bb-aae9-c7ba7e9dac06 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:47.884706 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8556ae6e-edad-40bb-aae9-c7ba7e9dac06 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:48.017253 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-8556ae6e-edad-40bb-aae9-c7ba7e9dac06 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:48.024995 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-8556ae6e-edad-40bb-aae9-c7ba7e9dac06 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609" status: 200 len: 1370 microversion: 2.1 time: 0.153967 Jun 22 10:23:48.025563 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 227/431] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:47 2022] GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609 => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:49.042393 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-7187b366-e88c-4444-9c4b-0f46d86f7c4b tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:49.043019 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-7187b366-e88c-4444-9c4b-0f46d86f7c4b tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 156c832e-e672-428f-9404-1e2964ae5609] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:49.050286 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7187b366-e88c-4444-9c4b-0f46d86f7c4b tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:49.050728 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7187b366-e88c-4444-9c4b-0f46d86f7c4b tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:49.051534 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7187b366-e88c-4444-9c4b-0f46d86f7c4b tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:49.051978 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7187b366-e88c-4444-9c4b-0f46d86f7c4b tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:49.205566 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-7187b366-e88c-4444-9c4b-0f46d86f7c4b tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:49.214064 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-7187b366-e88c-4444-9c4b-0f46d86f7c4b tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609" status: 200 len: 1370 microversion: 2.1 time: 0.176211 Jun 22 10:23:49.214645 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 205/432] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:49 2022] GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609 => generated 1370 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:50.230951 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-348a6555-adf5-47fb-9e79-d18ddee6561a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:50.231678 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-348a6555-adf5-47fb-9e79-d18ddee6561a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 156c832e-e672-428f-9404-1e2964ae5609] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:50.237831 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-348a6555-adf5-47fb-9e79-d18ddee6561a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:50.238270 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-348a6555-adf5-47fb-9e79-d18ddee6561a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:50.239088 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-348a6555-adf5-47fb-9e79-d18ddee6561a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:50.239522 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-348a6555-adf5-47fb-9e79-d18ddee6561a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:50.377878 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-348a6555-adf5-47fb-9e79-d18ddee6561a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:50.386043 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-348a6555-adf5-47fb-9e79-d18ddee6561a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609" status: 200 len: 1370 microversion: 2.1 time: 0.158917 Jun 22 10:23:50.386814 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 228/433] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:50 2022] GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609 => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:51.403552 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-095c6bf9-c603-4465-89b0-060974393bbd tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:51.405576 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-095c6bf9-c603-4465-89b0-060974393bbd tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 156c832e-e672-428f-9404-1e2964ae5609] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:51.412334 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-095c6bf9-c603-4465-89b0-060974393bbd tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:51.412801 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-095c6bf9-c603-4465-89b0-060974393bbd tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:51.413554 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-095c6bf9-c603-4465-89b0-060974393bbd tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:51.414255 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-095c6bf9-c603-4465-89b0-060974393bbd tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:51.551949 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-095c6bf9-c603-4465-89b0-060974393bbd tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:51.560126 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-095c6bf9-c603-4465-89b0-060974393bbd tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609" status: 200 len: 1370 microversion: 2.1 time: 0.160477 Jun 22 10:23:51.560761 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 206/434] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:51 2022] GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609 => generated 1370 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:23:52.576730 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-6f3b1d80-103c-4761-a118-5468dc286068 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:52.577326 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-6f3b1d80-103c-4761-a118-5468dc286068 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 156c832e-e672-428f-9404-1e2964ae5609] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:52.584420 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6f3b1d80-103c-4761-a118-5468dc286068 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:52.584858 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6f3b1d80-103c-4761-a118-5468dc286068 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:52.591776 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6f3b1d80-103c-4761-a118-5468dc286068 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:52.591776 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6f3b1d80-103c-4761-a118-5468dc286068 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:52.746097 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-6f3b1d80-103c-4761-a118-5468dc286068 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:52.753964 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-6f3b1d80-103c-4761-a118-5468dc286068 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609" status: 200 len: 1370 microversion: 2.1 time: 0.181116 Jun 22 10:23:52.754531 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 229/435] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:52 2022] GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609 => generated 1370 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:53.771786 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-3f527698-923a-47ad-8fe7-fd8aab2c63d2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:53.772392 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-3f527698-923a-47ad-8fe7-fd8aab2c63d2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 156c832e-e672-428f-9404-1e2964ae5609] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:53.775356 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_cell0:SELECT=6 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:53.781420 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3f527698-923a-47ad-8fe7-fd8aab2c63d2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:53.781885 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3f527698-923a-47ad-8fe7-fd8aab2c63d2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:53.782692 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3f527698-923a-47ad-8fe7-fd8aab2c63d2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:53.783134 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3f527698-923a-47ad-8fe7-fd8aab2c63d2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:53.921803 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-3f527698-923a-47ad-8fe7-fd8aab2c63d2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:53.930248 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-3f527698-923a-47ad-8fe7-fd8aab2c63d2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609" status: 200 len: 1370 microversion: 2.1 time: 0.162319 Jun 22 10:23:53.931458 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 207/436] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:53 2022] GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609 => generated 1370 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:54.949159 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-3370039f-5031-4b40-90b7-a7e79c8a435e tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:54.949705 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-3370039f-5031-4b40-90b7-a7e79c8a435e tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 156c832e-e672-428f-9404-1e2964ae5609] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:54.951759 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell0:SELECT=2 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:54.952577 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell0:SELECT=6 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:54.958972 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3370039f-5031-4b40-90b7-a7e79c8a435e tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:54.959422 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3370039f-5031-4b40-90b7-a7e79c8a435e tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:54.960202 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3370039f-5031-4b40-90b7-a7e79c8a435e tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:54.960645 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3370039f-5031-4b40-90b7-a7e79c8a435e tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:55.091378 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-3370039f-5031-4b40-90b7-a7e79c8a435e tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:55.099559 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-3370039f-5031-4b40-90b7-a7e79c8a435e tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609" status: 200 len: 1370 microversion: 2.1 time: 0.154530 Jun 22 10:23:55.100139 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 230/437] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:54 2022] GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609 => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:55.831605 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-7f95d213-656e-4e11-80d8-f2cb242b5aa9 req-bd82b33e-63a7-4583-bea1-52ea03e22af1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "156c832e-e672-428f-9404-1e2964ae5609", "name": "network-vif-plugged", "status": "completed", "tag": "d5a527b2-317f-467a-b39d-b955e3a5dea6"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:23:55.841286 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-7f95d213-656e-4e11-80d8-f2cb242b5aa9 req-bd82b33e-63a7-4583-bea1-52ea03e22af1 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:55.841734 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-7f95d213-656e-4e11-80d8-f2cb242b5aa9 req-bd82b33e-63a7-4583-bea1-52ea03e22af1 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:55.853404 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-7f95d213-656e-4e11-80d8-f2cb242b5aa9 req-bd82b33e-63a7-4583-bea1-52ea03e22af1 service nova] Creating event network-vif-plugged:d5a527b2-317f-467a-b39d-b955e3a5dea6 for instance 156c832e-e672-428f-9404-1e2964ae5609 on hv-cinder-84713 Jun 22 10:23:55.859205 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-7f95d213-656e-4e11-80d8-f2cb242b5aa9 req-bd82b33e-63a7-4583-bea1-52ea03e22af1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030873 Jun 22 10:23:55.859708 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 208/438] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:23:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:23:56.116523 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-1074bab5-eb10-42ad-959b-c6a76cdfb7e9 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:56.117131 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-1074bab5-eb10-42ad-959b-c6a76cdfb7e9 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 156c832e-e672-428f-9404-1e2964ae5609] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:56.123609 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1074bab5-eb10-42ad-959b-c6a76cdfb7e9 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:56.124062 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1074bab5-eb10-42ad-959b-c6a76cdfb7e9 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:56.124830 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1074bab5-eb10-42ad-959b-c6a76cdfb7e9 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:56.125267 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1074bab5-eb10-42ad-959b-c6a76cdfb7e9 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:56.264150 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-1074bab5-eb10-42ad-959b-c6a76cdfb7e9 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:56.271787 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-1074bab5-eb10-42ad-959b-c6a76cdfb7e9 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609" status: 200 len: 1370 microversion: 2.1 time: 0.159190 Jun 22 10:23:56.272366 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 231/439] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:56 2022] GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609 => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:23:57.292843 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-be6f8697-12f2-42d8-aefa-840af6b220a7 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:57.293569 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-be6f8697-12f2-42d8-aefa-840af6b220a7 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 156c832e-e672-428f-9404-1e2964ae5609] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:57.300310 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-be6f8697-12f2-42d8-aefa-840af6b220a7 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:57.300687 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-be6f8697-12f2-42d8-aefa-840af6b220a7 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:57.301447 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-be6f8697-12f2-42d8-aefa-840af6b220a7 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:57.301886 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-be6f8697-12f2-42d8-aefa-840af6b220a7 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:57.456320 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-be6f8697-12f2-42d8-aefa-840af6b220a7 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:57.465290 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-be6f8697-12f2-42d8-aefa-840af6b220a7 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609" status: 200 len: 1370 microversion: 2.1 time: 0.178463 Jun 22 10:23:57.465855 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 209/440] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:57 2022] GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609 => generated 1370 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:58.482669 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-1b657a48-dc22-4589-a2f0-e82c44d4c72a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:58.483749 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-1b657a48-dc22-4589-a2f0-e82c44d4c72a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 156c832e-e672-428f-9404-1e2964ae5609] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:58.499593 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1b657a48-dc22-4589-a2f0-e82c44d4c72a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:58.500185 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1b657a48-dc22-4589-a2f0-e82c44d4c72a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:58.504042 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1b657a48-dc22-4589-a2f0-e82c44d4c72a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:58.504518 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1b657a48-dc22-4589-a2f0-e82c44d4c72a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:58.509448 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:SELECT=99 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:23:58.663475 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-1b657a48-dc22-4589-a2f0-e82c44d4c72a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:58.670835 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-1b657a48-dc22-4589-a2f0-e82c44d4c72a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609" status: 200 len: 1370 microversion: 2.1 time: 0.192215 Jun 22 10:23:58.671500 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 232/441] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:58 2022] GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609 => generated 1370 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:59.688300 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-042e0934-8a4b-45b3-bfe5-4d9bb035b84d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:59.688918 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-042e0934-8a4b-45b3-bfe5-4d9bb035b84d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 156c832e-e672-428f-9404-1e2964ae5609] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:59.695230 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-042e0934-8a4b-45b3-bfe5-4d9bb035b84d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:59.695750 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-042e0934-8a4b-45b3-bfe5-4d9bb035b84d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:59.696642 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-042e0934-8a4b-45b3-bfe5-4d9bb035b84d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:59.697070 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-042e0934-8a4b-45b3-bfe5-4d9bb035b84d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:59.828132 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-042e0934-8a4b-45b3-bfe5-4d9bb035b84d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:23:59.835755 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-042e0934-8a4b-45b3-bfe5-4d9bb035b84d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609" status: 200 len: 1563 microversion: 2.1 time: 0.151369 Jun 22 10:23:59.836316 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 210/442] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:23:59 2022] GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609 => generated 1563 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:23:59.852306 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-e687f784-28a2-4271-b4f6-6eb653e2400d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:23:59.852919 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-e687f784-28a2-4271-b4f6-6eb653e2400d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 156c832e-e672-428f-9404-1e2964ae5609] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:23:59.860540 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e687f784-28a2-4271-b4f6-6eb653e2400d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:59.861146 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e687f784-28a2-4271-b4f6-6eb653e2400d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:59.862011 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e687f784-28a2-4271-b4f6-6eb653e2400d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:23:59.862540 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e687f784-28a2-4271-b4f6-6eb653e2400d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:23:59.942107 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-e687f784-28a2-4271-b4f6-6eb653e2400d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093618 Jun 22 10:23:59.942732 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 233/443] 10.222.0.66 () {58 vars in 1274 bytes} [Wed Jun 22 10:23:59 2022] GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:24:00.919286 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-3f4daf74-3e95-4864-a050-0160b7f4e6ee req-c5f42a0a-17a5-462b-9265-da41c495a22d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "156c832e-e672-428f-9404-1e2964ae5609", "tag": "d5a527b2-317f-467a-b39d-b955e3a5dea6"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:24:00.925454 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=1 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:24:00.930315 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-3f4daf74-3e95-4864-a050-0160b7f4e6ee req-c5f42a0a-17a5-462b-9265-da41c495a22d service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:24:00.930787 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-3f4daf74-3e95-4864-a050-0160b7f4e6ee req-c5f42a0a-17a5-462b-9265-da41c495a22d service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:24:00.942977 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-3f4daf74-3e95-4864-a050-0160b7f4e6ee req-c5f42a0a-17a5-462b-9265-da41c495a22d service nova] Creating event network-changed:d5a527b2-317f-467a-b39d-b955e3a5dea6 for instance 156c832e-e672-428f-9404-1e2964ae5609 on hv-cinder-84713 Jun 22 10:24:00.948330 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-3f4daf74-3e95-4864-a050-0160b7f4e6ee req-c5f42a0a-17a5-462b-9265-da41c495a22d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032717 Jun 22 10:24:00.949050 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 211/444] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:24:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:24:10.293167 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 10:24:10.293917 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Wed Jun 22 10:24:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 10:25:08.288662 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:25:08.289361 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:SELECT=9 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:25:08.294112 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-b1983f1c-e4b0-405c-8980-4b4dacfd601a tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:08.294629 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-b1983f1c-e4b0-405c-8980-4b4dacfd601a tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:08.302279 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b1983f1c-e4b0-405c-8980-4b4dacfd601a tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:08.302763 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b1983f1c-e4b0-405c-8980-4b4dacfd601a tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:08.303531 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b1983f1c-e4b0-405c-8980-4b4dacfd601a tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:08.303968 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b1983f1c-e4b0-405c-8980-4b4dacfd601a tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:08.328407 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-b1983f1c-e4b0-405c-8980-4b4dacfd601a tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d/ips" status: 200 len: 151 microversion: 2.20 time: 0.041186 Jun 22 10:25:08.328963 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 234/445] 10.222.0.66 () {60 vars in 1288 bytes} [Wed Jun 22 10:25:08 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d/ips => generated 151 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 10:25:11.263873 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_cell1:SELECT=49 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:25:11.268998 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-02e5f5e7-ed9f-4d95-a328-9e7fd157cda1 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:25:11.269633 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-02e5f5e7-ed9f-4d95-a328-9e7fd157cda1 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:11.276778 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-02e5f5e7-ed9f-4d95-a328-9e7fd157cda1 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:11.277232 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-02e5f5e7-ed9f-4d95-a328-9e7fd157cda1 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:11.278028 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-02e5f5e7-ed9f-4d95-a328-9e7fd157cda1 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:11.278465 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-02e5f5e7-ed9f-4d95-a328-9e7fd157cda1 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:11.303308 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.objects.instance [None req-02e5f5e7-ed9f-4d95-a328-9e7fd157cda1 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lazy-loading 'flavor' on Instance uuid 755c0b10-e04a-42fa-86da-8cc65537315d {{(pid=117679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:25:11.581982 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-02e5f5e7-ed9f-4d95-a328-9e7fd157cda1 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "POST /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d/action" status: 202 len: 0 microversion: 2.20 time: 0.320069 Jun 22 10:25:11.582612 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 212/446] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Jun 22 10:25:11 2022] POST /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d/action => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 22 10:25:11.592164 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-059498f9-46f6-42bd-a443-f78814ac270c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:11.592764 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-059498f9-46f6-42bd-a443-f78814ac270c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:11.599587 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-059498f9-46f6-42bd-a443-f78814ac270c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:11.600033 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-059498f9-46f6-42bd-a443-f78814ac270c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:11.600962 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-059498f9-46f6-42bd-a443-f78814ac270c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:11.601499 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-059498f9-46f6-42bd-a443-f78814ac270c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:11.736347 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-059498f9-46f6-42bd-a443-f78814ac270c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:11.744970 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-059498f9-46f6-42bd-a443-f78814ac270c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:11.746472 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-059498f9-46f6-42bd-a443-f78814ac270c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:11.747664 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-059498f9-46f6-42bd-a443-f78814ac270c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1724 microversion: 2.20 time: 0.159477 Jun 22 10:25:11.748260 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 235/447] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:25:11 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:25:12.768146 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-6e9308f7-748b-4f54-907d-1a423f7b01e9 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:12.768839 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-6e9308f7-748b-4f54-907d-1a423f7b01e9 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:12.775906 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6e9308f7-748b-4f54-907d-1a423f7b01e9 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:12.776357 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6e9308f7-748b-4f54-907d-1a423f7b01e9 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:12.777123 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6e9308f7-748b-4f54-907d-1a423f7b01e9 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:12.777552 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6e9308f7-748b-4f54-907d-1a423f7b01e9 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:12.927632 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-6e9308f7-748b-4f54-907d-1a423f7b01e9 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:12.936495 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-6e9308f7-748b-4f54-907d-1a423f7b01e9 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:12.937979 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-6e9308f7-748b-4f54-907d-1a423f7b01e9 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:12.939166 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-6e9308f7-748b-4f54-907d-1a423f7b01e9 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1724 microversion: 2.20 time: 0.175980 Jun 22 10:25:12.939759 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 213/448] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:25:12 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:25:13.959188 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-625cfdc5-9083-434c-91fd-e5650868dca2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:13.959865 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-625cfdc5-9083-434c-91fd-e5650868dca2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:13.968120 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-625cfdc5-9083-434c-91fd-e5650868dca2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:13.968681 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-625cfdc5-9083-434c-91fd-e5650868dca2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:13.969629 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-625cfdc5-9083-434c-91fd-e5650868dca2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:13.970202 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-625cfdc5-9083-434c-91fd-e5650868dca2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:14.120969 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-625cfdc5-9083-434c-91fd-e5650868dca2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:14.129596 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-625cfdc5-9083-434c-91fd-e5650868dca2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:14.131125 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-625cfdc5-9083-434c-91fd-e5650868dca2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:14.132290 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-625cfdc5-9083-434c-91fd-e5650868dca2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1724 microversion: 2.20 time: 0.178210 Jun 22 10:25:14.132855 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 236/449] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:25:13 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:25:15.055121 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-e6370700-d175-4c76-a3fa-9391a077988b tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:15.055707 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-e6370700-d175-4c76-a3fa-9391a077988b tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: da28df11-c078-43d5-81c4-e78ccf9f6504] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:15.065282 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e6370700-d175-4c76-a3fa-9391a077988b tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:15.066032 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e6370700-d175-4c76-a3fa-9391a077988b tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:15.067320 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e6370700-d175-4c76-a3fa-9391a077988b tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:15.068067 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e6370700-d175-4c76-a3fa-9391a077988b tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:15.094244 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-e6370700-d175-4c76-a3fa-9391a077988b tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504/ips" status: 200 len: 145 microversion: 2.1 time: 0.043090 Jun 22 10:25:15.094829 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 214/450] 10.222.0.66 () {58 vars in 1247 bytes} [Wed Jun 22 10:25:15 2022] GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504/ips => generated 145 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:25:15.151092 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-0e078733-8aea-4ce2-ab60-cd18991b7d1a tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:15.151652 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-0e078733-8aea-4ce2-ab60-cd18991b7d1a tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:15.159086 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0e078733-8aea-4ce2-ab60-cd18991b7d1a tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:15.159566 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0e078733-8aea-4ce2-ab60-cd18991b7d1a tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:15.160360 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0e078733-8aea-4ce2-ab60-cd18991b7d1a tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:15.160799 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0e078733-8aea-4ce2-ab60-cd18991b7d1a tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:15.544239 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-0e078733-8aea-4ce2-ab60-cd18991b7d1a tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:15.552995 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-0e078733-8aea-4ce2-ab60-cd18991b7d1a tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:15.554542 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-0e078733-8aea-4ce2-ab60-cd18991b7d1a tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:15.556221 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-0e078733-8aea-4ce2-ab60-cd18991b7d1a tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1724 microversion: 2.20 time: 0.409056 Jun 22 10:25:15.557099 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 237/451] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:25:15 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1724 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:25:16.580812 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-21305143-8489-438a-8b78-4feba69fb394 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:16.581426 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-21305143-8489-438a-8b78-4feba69fb394 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:16.588161 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-21305143-8489-438a-8b78-4feba69fb394 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:16.588613 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-21305143-8489-438a-8b78-4feba69fb394 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:16.589397 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-21305143-8489-438a-8b78-4feba69fb394 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:16.589833 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-21305143-8489-438a-8b78-4feba69fb394 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:16.729684 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-21305143-8489-438a-8b78-4feba69fb394 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:16.742776 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-21305143-8489-438a-8b78-4feba69fb394 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:16.745003 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-21305143-8489-438a-8b78-4feba69fb394 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:16.746209 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-21305143-8489-438a-8b78-4feba69fb394 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1724 microversion: 2.20 time: 0.169375 Jun 22 10:25:16.746884 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 215/452] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:25:16 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:25:17.156936 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-82b17bd9-8e69-4143-8d93-277b257653f1 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0397d9c5-c8a2-4249-948f-ac59cc55909e"}} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:25:17.158073 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-82b17bd9-8e69-4143-8d93-277b257653f1 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: da28df11-c078-43d5-81c4-e78ccf9f6504] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:17.164425 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-82b17bd9-8e69-4143-8d93-277b257653f1 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:17.164889 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-82b17bd9-8e69-4143-8d93-277b257653f1 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:17.165756 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-82b17bd9-8e69-4143-8d93-277b257653f1 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:17.166304 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-82b17bd9-8e69-4143-8d93-277b257653f1 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:17.537652 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-82b17bd9-8e69-4143-8d93-277b257653f1 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "POST /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.385407 Jun 22 10:25:17.538265 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 238/453] 10.222.0.66 () {60 vars in 1322 bytes} [Wed Jun 22 10:25:17 2022] POST /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504/os-volume_attachments => generated 194 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:25:17.770821 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-5885f2bb-1c67-4dd6-9206-8f455cf3151c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:17.771383 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-5885f2bb-1c67-4dd6-9206-8f455cf3151c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:17.779706 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5885f2bb-1c67-4dd6-9206-8f455cf3151c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:17.780199 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5885f2bb-1c67-4dd6-9206-8f455cf3151c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:17.781090 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5885f2bb-1c67-4dd6-9206-8f455cf3151c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:17.781560 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5885f2bb-1c67-4dd6-9206-8f455cf3151c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:17.930338 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-5885f2bb-1c67-4dd6-9206-8f455cf3151c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:17.938635 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-5885f2bb-1c67-4dd6-9206-8f455cf3151c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:17.940135 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-5885f2bb-1c67-4dd6-9206-8f455cf3151c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:17.941296 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-5885f2bb-1c67-4dd6-9206-8f455cf3151c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1724 microversion: 2.20 time: 0.175210 Jun 22 10:25:17.941850 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 216/454] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:25:17 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:25:18.963316 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-4511a7a7-58dc-4d69-97a3-07c65b59c6c1 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:18.964115 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-4511a7a7-58dc-4d69-97a3-07c65b59c6c1 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:18.976089 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4511a7a7-58dc-4d69-97a3-07c65b59c6c1 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:18.976763 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4511a7a7-58dc-4d69-97a3-07c65b59c6c1 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:18.977843 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4511a7a7-58dc-4d69-97a3-07c65b59c6c1 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:18.978392 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4511a7a7-58dc-4d69-97a3-07c65b59c6c1 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:19.127012 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-4511a7a7-58dc-4d69-97a3-07c65b59c6c1 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:19.137933 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-4511a7a7-58dc-4d69-97a3-07c65b59c6c1 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:19.140136 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-4511a7a7-58dc-4d69-97a3-07c65b59c6c1 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:19.141854 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-4511a7a7-58dc-4d69-97a3-07c65b59c6c1 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1724 microversion: 2.20 time: 0.184829 Jun 22 10:25:19.142536 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 239/455] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:25:18 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:25:20.168103 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-1fc7979c-7f33-476f-95e9-18ffda7f032c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:20.169402 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-1fc7979c-7f33-476f-95e9-18ffda7f032c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:20.185314 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1fc7979c-7f33-476f-95e9-18ffda7f032c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:20.185772 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1fc7979c-7f33-476f-95e9-18ffda7f032c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:20.186552 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1fc7979c-7f33-476f-95e9-18ffda7f032c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:20.187112 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1fc7979c-7f33-476f-95e9-18ffda7f032c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:20.332150 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-1fc7979c-7f33-476f-95e9-18ffda7f032c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:20.345111 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-1fc7979c-7f33-476f-95e9-18ffda7f032c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:20.347392 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-1fc7979c-7f33-476f-95e9-18ffda7f032c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:20.349158 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-1fc7979c-7f33-476f-95e9-18ffda7f032c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1724 microversion: 2.20 time: 0.187555 Jun 22 10:25:20.350047 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 217/456] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:25:20 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:25:21.371163 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-484a7a8c-f552-49cd-bfcb-1b3a815b0200 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:21.371874 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-484a7a8c-f552-49cd-bfcb-1b3a815b0200 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:21.379453 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-484a7a8c-f552-49cd-bfcb-1b3a815b0200 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:21.379904 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-484a7a8c-f552-49cd-bfcb-1b3a815b0200 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:21.380681 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-484a7a8c-f552-49cd-bfcb-1b3a815b0200 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:21.381121 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-484a7a8c-f552-49cd-bfcb-1b3a815b0200 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:21.527647 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-484a7a8c-f552-49cd-bfcb-1b3a815b0200 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:21.536633 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-484a7a8c-f552-49cd-bfcb-1b3a815b0200 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:21.538123 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-484a7a8c-f552-49cd-bfcb-1b3a815b0200 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:21.539358 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-484a7a8c-f552-49cd-bfcb-1b3a815b0200 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1724 microversion: 2.20 time: 0.173788 Jun 22 10:25:21.540152 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 240/457] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:25:21 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:25:22.428896 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-09532ca7-30da-40e3-ab15-e8301ba8255a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:22.429460 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-09532ca7-30da-40e3-ab15-e8301ba8255a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: c9505087-b458-46dc-9fbb-ee4ef61decde] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:22.436536 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-09532ca7-30da-40e3-ab15-e8301ba8255a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:22.436989 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-09532ca7-30da-40e3-ab15-e8301ba8255a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:22.437754 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-09532ca7-30da-40e3-ab15-e8301ba8255a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:22.438189 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-09532ca7-30da-40e3-ab15-e8301ba8255a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:22.466030 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-09532ca7-30da-40e3-ab15-e8301ba8255a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde/ips" status: 200 len: 150 microversion: 2.1 time: 0.040587 Jun 22 10:25:22.466834 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 218/458] 10.222.0.66 () {58 vars in 1247 bytes} [Wed Jun 22 10:25:22 2022] GET /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde/ips => generated 150 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:25:22.557489 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-9a2f8dce-7490-4f57-82ee-c7d32f4dec05 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:22.558126 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-9a2f8dce-7490-4f57-82ee-c7d32f4dec05 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:22.565118 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9a2f8dce-7490-4f57-82ee-c7d32f4dec05 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:22.565569 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9a2f8dce-7490-4f57-82ee-c7d32f4dec05 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:22.566341 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9a2f8dce-7490-4f57-82ee-c7d32f4dec05 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:22.566802 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9a2f8dce-7490-4f57-82ee-c7d32f4dec05 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:22.709638 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-9a2f8dce-7490-4f57-82ee-c7d32f4dec05 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:22.719658 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-9a2f8dce-7490-4f57-82ee-c7d32f4dec05 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:22.722799 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-9a2f8dce-7490-4f57-82ee-c7d32f4dec05 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:22.723993 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-9a2f8dce-7490-4f57-82ee-c7d32f4dec05 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1724 microversion: 2.20 time: 0.170417 Jun 22 10:25:22.724771 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 241/459] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:25:22 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:25:23.743077 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-1c8dd937-d7a9-498a-a422-8715284556b4 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:23.743708 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-1c8dd937-d7a9-498a-a422-8715284556b4 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:23.750936 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1c8dd937-d7a9-498a-a422-8715284556b4 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:23.751384 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1c8dd937-d7a9-498a-a422-8715284556b4 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:23.752153 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1c8dd937-d7a9-498a-a422-8715284556b4 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:23.752583 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1c8dd937-d7a9-498a-a422-8715284556b4 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:23.875506 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-84e6ef68-5e6d-413a-ae61-0c73d210bf3c tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2ac05241-ea18-4902-9d40-ed08ff278b9e"}} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:25:23.876674 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-84e6ef68-5e6d-413a-ae61-0c73d210bf3c tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: c9505087-b458-46dc-9fbb-ee4ef61decde] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:23.883526 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-84e6ef68-5e6d-413a-ae61-0c73d210bf3c tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:23.883993 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-84e6ef68-5e6d-413a-ae61-0c73d210bf3c tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:23.884775 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-84e6ef68-5e6d-413a-ae61-0c73d210bf3c tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:23.885216 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-84e6ef68-5e6d-413a-ae61-0c73d210bf3c tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:23.902442 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-1c8dd937-d7a9-498a-a422-8715284556b4 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:23.915724 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-1c8dd937-d7a9-498a-a422-8715284556b4 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:23.918374 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-1c8dd937-d7a9-498a-a422-8715284556b4 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:23.919589 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-1c8dd937-d7a9-498a-a422-8715284556b4 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1724 microversion: 2.20 time: 0.180553 Jun 22 10:25:23.920150 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 219/460] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:25:23 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:25:24.138832 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-84e6ef68-5e6d-413a-ae61-0c73d210bf3c tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "POST /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.267253 Jun 22 10:25:24.139455 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 242/461] 10.222.0.66 () {60 vars in 1322 bytes} [Wed Jun 22 10:25:23 2022] POST /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde/os-volume_attachments => generated 194 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:25:24.938057 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-4c89cad3-cbdd-42d9-a0f2-e25ddb6cc921 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:24.938776 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-4c89cad3-cbdd-42d9-a0f2-e25ddb6cc921 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:24.945618 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4c89cad3-cbdd-42d9-a0f2-e25ddb6cc921 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:24.946068 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4c89cad3-cbdd-42d9-a0f2-e25ddb6cc921 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:24.946861 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4c89cad3-cbdd-42d9-a0f2-e25ddb6cc921 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:24.947302 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4c89cad3-cbdd-42d9-a0f2-e25ddb6cc921 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:25.083006 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-4c89cad3-cbdd-42d9-a0f2-e25ddb6cc921 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:25.093403 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-4c89cad3-cbdd-42d9-a0f2-e25ddb6cc921 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:25.094955 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-4c89cad3-cbdd-42d9-a0f2-e25ddb6cc921 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:25.096091 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-4c89cad3-cbdd-42d9-a0f2-e25ddb6cc921 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1724 microversion: 2.20 time: 0.162321 Jun 22 10:25:25.096696 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 220/462] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:25:24 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:25:26.116272 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-fd6b2295-75d0-475c-adf0-bf37346b3545 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:26.117431 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-fd6b2295-75d0-475c-adf0-bf37346b3545 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:26.124540 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fd6b2295-75d0-475c-adf0-bf37346b3545 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:26.125024 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fd6b2295-75d0-475c-adf0-bf37346b3545 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:26.125829 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fd6b2295-75d0-475c-adf0-bf37346b3545 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:26.126287 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fd6b2295-75d0-475c-adf0-bf37346b3545 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:26.272828 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-fd6b2295-75d0-475c-adf0-bf37346b3545 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:26.281422 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-fd6b2295-75d0-475c-adf0-bf37346b3545 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:26.283166 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-fd6b2295-75d0-475c-adf0-bf37346b3545 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:26.284404 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-fd6b2295-75d0-475c-adf0-bf37346b3545 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1724 microversion: 2.20 time: 0.172988 Jun 22 10:25:26.285255 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 243/463] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:25:26 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:25:27.303593 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-1b1473a3-0f9e-4b15-9987-d2f56c4ea052 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:27.304237 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-1b1473a3-0f9e-4b15-9987-d2f56c4ea052 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:27.311504 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1b1473a3-0f9e-4b15-9987-d2f56c4ea052 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:27.311952 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1b1473a3-0f9e-4b15-9987-d2f56c4ea052 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:27.312724 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1b1473a3-0f9e-4b15-9987-d2f56c4ea052 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:27.313161 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1b1473a3-0f9e-4b15-9987-d2f56c4ea052 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:27.449205 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-1b1473a3-0f9e-4b15-9987-d2f56c4ea052 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:27.457678 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-1b1473a3-0f9e-4b15-9987-d2f56c4ea052 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:27.459226 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-1b1473a3-0f9e-4b15-9987-d2f56c4ea052 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:27.460429 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-1b1473a3-0f9e-4b15-9987-d2f56c4ea052 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1724 microversion: 2.20 time: 0.161150 Jun 22 10:25:27.460961 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 221/464] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:25:27 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:25:28.480042 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-f5004b16-04dc-4b16-b1c2-50765d99571b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:28.481401 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-f5004b16-04dc-4b16-b1c2-50765d99571b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:28.488809 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f5004b16-04dc-4b16-b1c2-50765d99571b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:28.489264 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f5004b16-04dc-4b16-b1c2-50765d99571b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:28.490043 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f5004b16-04dc-4b16-b1c2-50765d99571b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:28.490479 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f5004b16-04dc-4b16-b1c2-50765d99571b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:28.639054 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-f5004b16-04dc-4b16-b1c2-50765d99571b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:28.651252 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-f5004b16-04dc-4b16-b1c2-50765d99571b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:28.653473 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-f5004b16-04dc-4b16-b1c2-50765d99571b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:28.655430 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-f5004b16-04dc-4b16-b1c2-50765d99571b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1724 microversion: 2.20 time: 0.179270 Jun 22 10:25:28.656396 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 244/465] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:25:28 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:25:29.304681 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-2efa3476-b901-458e-b90e-dbd858724546 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:25:29.311722 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2efa3476-b901-458e-b90e-dbd858724546 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:29.312168 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2efa3476-b901-458e-b90e-dbd858724546 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:29.372322 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-2efa3476-b901-458e-b90e-dbd858724546 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: da28df11-c078-43d5-81c4-e78ccf9f6504] Going to try to stop instance {{(pid=117679) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 22 10:25:29.420319 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-2efa3476-b901-458e-b90e-dbd858724546 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "POST /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504/action" status: 202 len: 0 microversion: 2.1 time: 0.119418 Jun 22 10:25:29.420905 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 222/466] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Jun 22 10:25:29 2022] POST /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:25:29.428994 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-d12c0622-eba4-482f-9e77-602cb72b7eae tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:29.429676 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-d12c0622-eba4-482f-9e77-602cb72b7eae tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: da28df11-c078-43d5-81c4-e78ccf9f6504] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:29.436296 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d12c0622-eba4-482f-9e77-602cb72b7eae tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:29.436663 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d12c0622-eba4-482f-9e77-602cb72b7eae tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:29.437604 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d12c0622-eba4-482f-9e77-602cb72b7eae tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:29.438034 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d12c0622-eba4-482f-9e77-602cb72b7eae tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:29.571395 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-d12c0622-eba4-482f-9e77-602cb72b7eae tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:29.579555 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-d12c0622-eba4-482f-9e77-602cb72b7eae tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504" status: 200 len: 1724 microversion: 2.1 time: 0.154453 Jun 22 10:25:29.580153 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 245/467] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:29 2022] GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:25:29.675191 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-2960204b-8c81-411f-b3da-1a5329ab6534 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:29.675888 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-2960204b-8c81-411f-b3da-1a5329ab6534 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:29.682749 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2960204b-8c81-411f-b3da-1a5329ab6534 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:29.683204 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2960204b-8c81-411f-b3da-1a5329ab6534 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:29.684127 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2960204b-8c81-411f-b3da-1a5329ab6534 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:29.684533 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2960204b-8c81-411f-b3da-1a5329ab6534 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:29.829114 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-2960204b-8c81-411f-b3da-1a5329ab6534 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:29.840078 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-2960204b-8c81-411f-b3da-1a5329ab6534 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:29.841607 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-2960204b-8c81-411f-b3da-1a5329ab6534 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:29.842816 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-2960204b-8c81-411f-b3da-1a5329ab6534 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1724 microversion: 2.20 time: 0.172019 Jun 22 10:25:29.843347 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 223/468] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:25:29 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:25:30.599205 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-853eb45c-22c0-4441-bfd7-a0162aaae878 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:30.600036 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-853eb45c-22c0-4441-bfd7-a0162aaae878 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: da28df11-c078-43d5-81c4-e78ccf9f6504] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:30.609216 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-853eb45c-22c0-4441-bfd7-a0162aaae878 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:30.609655 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-853eb45c-22c0-4441-bfd7-a0162aaae878 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:30.610412 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-853eb45c-22c0-4441-bfd7-a0162aaae878 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:30.610877 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-853eb45c-22c0-4441-bfd7-a0162aaae878 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:30.746181 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-853eb45c-22c0-4441-bfd7-a0162aaae878 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:30.754541 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-853eb45c-22c0-4441-bfd7-a0162aaae878 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504" status: 200 len: 1724 microversion: 2.1 time: 0.160547 Jun 22 10:25:30.755179 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 246/469] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:30 2022] GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:25:30.868824 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-ea84b03b-b4d8-45d5-ab6a-2c7995900737 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:30.869705 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-ea84b03b-b4d8-45d5-ab6a-2c7995900737 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:30.877932 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ea84b03b-b4d8-45d5-ab6a-2c7995900737 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:30.878373 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ea84b03b-b4d8-45d5-ab6a-2c7995900737 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:30.879189 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ea84b03b-b4d8-45d5-ab6a-2c7995900737 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:30.879619 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ea84b03b-b4d8-45d5-ab6a-2c7995900737 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:31.036772 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-ea84b03b-b4d8-45d5-ab6a-2c7995900737 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:31.044944 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-ea84b03b-b4d8-45d5-ab6a-2c7995900737 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:31.046469 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-ea84b03b-b4d8-45d5-ab6a-2c7995900737 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:31.047657 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-ea84b03b-b4d8-45d5-ab6a-2c7995900737 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1724 microversion: 2.20 time: 0.184090 Jun 22 10:25:31.048219 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 224/470] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:25:30 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:25:31.776171 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-0614b564-f2b3-43b4-b1ad-30c49d634eef tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:31.776797 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-0614b564-f2b3-43b4-b1ad-30c49d634eef tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: da28df11-c078-43d5-81c4-e78ccf9f6504] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:31.784393 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0614b564-f2b3-43b4-b1ad-30c49d634eef tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:31.784840 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0614b564-f2b3-43b4-b1ad-30c49d634eef tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:31.785590 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0614b564-f2b3-43b4-b1ad-30c49d634eef tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:31.786021 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0614b564-f2b3-43b4-b1ad-30c49d634eef tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:32.065961 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-53c38ee3-5f8f-42d3-9dfb-0709de8d98b2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:32.066784 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-53c38ee3-5f8f-42d3-9dfb-0709de8d98b2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:32.073621 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-53c38ee3-5f8f-42d3-9dfb-0709de8d98b2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:32.074118 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-53c38ee3-5f8f-42d3-9dfb-0709de8d98b2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:32.074851 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-53c38ee3-5f8f-42d3-9dfb-0709de8d98b2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:32.075256 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-53c38ee3-5f8f-42d3-9dfb-0709de8d98b2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:32.128327 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-0614b564-f2b3-43b4-b1ad-30c49d634eef tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:32.136759 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-0614b564-f2b3-43b4-b1ad-30c49d634eef tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504" status: 200 len: 1724 microversion: 2.1 time: 0.364464 Jun 22 10:25:32.137445 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 247/471] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:31 2022] GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504 => generated 1724 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:25:32.278313 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-53c38ee3-5f8f-42d3-9dfb-0709de8d98b2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:32.290931 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-53c38ee3-5f8f-42d3-9dfb-0709de8d98b2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:32.293077 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-53c38ee3-5f8f-42d3-9dfb-0709de8d98b2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:32.294845 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-53c38ee3-5f8f-42d3-9dfb-0709de8d98b2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1745 microversion: 2.20 time: 0.232455 Jun 22 10:25:32.295787 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 225/472] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:25:32 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1745 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:25:33.158650 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-294c35e5-25fd-47e4-b127-8713e6f71dd6 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:33.159598 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-294c35e5-25fd-47e4-b127-8713e6f71dd6 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: da28df11-c078-43d5-81c4-e78ccf9f6504] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:33.169919 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-294c35e5-25fd-47e4-b127-8713e6f71dd6 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:33.170758 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-294c35e5-25fd-47e4-b127-8713e6f71dd6 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:33.171525 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-294c35e5-25fd-47e4-b127-8713e6f71dd6 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:33.171951 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-294c35e5-25fd-47e4-b127-8713e6f71dd6 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:33.176070 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:25:33.314798 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-586efb50-9765-484d-97ce-e0d56e375190 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:33.315324 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-294c35e5-25fd-47e4-b127-8713e6f71dd6 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:33.315447 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-586efb50-9765-484d-97ce-e0d56e375190 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:33.324272 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-586efb50-9765-484d-97ce-e0d56e375190 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:33.324874 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-586efb50-9765-484d-97ce-e0d56e375190 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:33.325053 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-294c35e5-25fd-47e4-b127-8713e6f71dd6 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504" status: 200 len: 1724 microversion: 2.1 time: 0.172717 Jun 22 10:25:33.325550 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-586efb50-9765-484d-97ce-e0d56e375190 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:33.325707 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 248/473] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:33 2022] GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:25:33.325988 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-586efb50-9765-484d-97ce-e0d56e375190 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:33.330780 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:25:33.465421 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-586efb50-9765-484d-97ce-e0d56e375190 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:33.473554 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-586efb50-9765-484d-97ce-e0d56e375190 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:33.475080 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-586efb50-9765-484d-97ce-e0d56e375190 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:33.476255 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-586efb50-9765-484d-97ce-e0d56e375190 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1745 microversion: 2.20 time: 0.166855 Jun 22 10:25:33.476803 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 226/474] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:25:33 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1745 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:25:34.347540 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-97725735-edcd-418a-8ae3-9f620364b6fa tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:34.348119 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-97725735-edcd-418a-8ae3-9f620364b6fa tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: da28df11-c078-43d5-81c4-e78ccf9f6504] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:34.357618 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-97725735-edcd-418a-8ae3-9f620364b6fa tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:34.358343 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-97725735-edcd-418a-8ae3-9f620364b6fa tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:34.359566 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-97725735-edcd-418a-8ae3-9f620364b6fa tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:34.359999 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-97725735-edcd-418a-8ae3-9f620364b6fa tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:34.499078 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-27ff73b8-9159-4a2e-827e-e4cebc6e0620 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:34.499686 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-27ff73b8-9159-4a2e-827e-e4cebc6e0620 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:34.505913 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-97725735-edcd-418a-8ae3-9f620364b6fa tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:34.512941 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-27ff73b8-9159-4a2e-827e-e4cebc6e0620 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:34.513722 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-27ff73b8-9159-4a2e-827e-e4cebc6e0620 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:34.514746 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-27ff73b8-9159-4a2e-827e-e4cebc6e0620 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:34.515284 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-27ff73b8-9159-4a2e-827e-e4cebc6e0620 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:34.516112 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-97725735-edcd-418a-8ae3-9f620364b6fa tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504" status: 200 len: 1724 microversion: 2.1 time: 0.177599 Jun 22 10:25:34.516929 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 249/475] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:34 2022] GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:25:34.651507 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-27ff73b8-9159-4a2e-827e-e4cebc6e0620 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:34.659967 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-27ff73b8-9159-4a2e-827e-e4cebc6e0620 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:34.661473 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-27ff73b8-9159-4a2e-827e-e4cebc6e0620 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:34.662665 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-27ff73b8-9159-4a2e-827e-e4cebc6e0620 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1745 microversion: 2.20 time: 0.167607 Jun 22 10:25:34.663226 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 227/476] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:25:34 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1745 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:25:35.535152 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-934448dc-d254-4a54-b258-feb4682f03b2 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:35.535780 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-934448dc-d254-4a54-b258-feb4682f03b2 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: da28df11-c078-43d5-81c4-e78ccf9f6504] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:35.542941 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-934448dc-d254-4a54-b258-feb4682f03b2 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:35.543424 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-934448dc-d254-4a54-b258-feb4682f03b2 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:35.544263 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-934448dc-d254-4a54-b258-feb4682f03b2 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:35.544727 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-934448dc-d254-4a54-b258-feb4682f03b2 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:35.681402 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-255be2b0-9487-4e74-bdef-d7bf0ff74476 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:35.682040 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-255be2b0-9487-4e74-bdef-d7bf0ff74476 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:35.689084 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-934448dc-d254-4a54-b258-feb4682f03b2 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:35.689273 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-255be2b0-9487-4e74-bdef-d7bf0ff74476 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:35.689273 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-255be2b0-9487-4e74-bdef-d7bf0ff74476 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:35.690198 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-255be2b0-9487-4e74-bdef-d7bf0ff74476 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:35.690761 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-255be2b0-9487-4e74-bdef-d7bf0ff74476 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:35.697939 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-934448dc-d254-4a54-b258-feb4682f03b2 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504" status: 200 len: 1724 microversion: 2.1 time: 0.166988 Jun 22 10:25:35.698750 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 250/477] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:35 2022] GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:25:35.848424 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-255be2b0-9487-4e74-bdef-d7bf0ff74476 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:35.857430 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-255be2b0-9487-4e74-bdef-d7bf0ff74476 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:35.859249 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-255be2b0-9487-4e74-bdef-d7bf0ff74476 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:35.860698 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-255be2b0-9487-4e74-bdef-d7bf0ff74476 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1745 microversion: 2.20 time: 0.183286 Jun 22 10:25:35.861653 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 228/478] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:25:35 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1745 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:25:35.912638 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-87ec8a7f-8c55-4f26-867a-33efe7ab2e5f tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Action: 'create', calling method: .version_select at 0x7f60d9938af0>, body: {"keypair": {"name": "tempest-keypair-1375683674", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDa3/Lo8jrcvZldp2zuuZ5PkfRSCBM+s0K/H+kwqP2kPQWs4lvCQDSVaintHnm/M/6xCskfBbw0igHS1G5uUsYD3IRYCIuQgjO8ssGRvYnN4ImsonXnGqIy38db9zQku9A=="}} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:25:35.927676 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.quota [None req-87ec8a7f-8c55-4f26-867a-33efe7ab2e5f tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Getting quotas for project 1db3fe97f51f47a98da3cbc8f0d55741. Resources: {'key_pairs'} {{(pid=117680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:25:35.931680 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.quota [None req-87ec8a7f-8c55-4f26-867a-33efe7ab2e5f tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Getting quotas for user da80b9a52feb462faf0469f2ab701fb8 and project 1db3fe97f51f47a98da3cbc8f0d55741. Resources: {'key_pairs'} {{(pid=117680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:25:35.961994 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-87ec8a7f-8c55-4f26-867a-33efe7ab2e5f tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.053329 Jun 22 10:25:35.962650 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 251/479] 10.222.0.66 () {60 vars in 1158 bytes} [Wed Jun 22 10:25:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:25:36.247516 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-302c2ba8-1846-41b5-8535-3f636c455a59 req-f27cb7a0-978e-4fd8-b89a-725780592523 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "755c0b10-e04a-42fa-86da-8cc65537315d", "name": "network-vif-plugged", "status": "completed", "tag": "2931da67-7e8b-43c4-9fbb-3adba1b7225a"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:25:36.264984 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-302c2ba8-1846-41b5-8535-3f636c455a59 req-f27cb7a0-978e-4fd8-b89a-725780592523 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:36.265649 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-302c2ba8-1846-41b5-8535-3f636c455a59 req-f27cb7a0-978e-4fd8-b89a-725780592523 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:36.280603 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-302c2ba8-1846-41b5-8535-3f636c455a59 req-f27cb7a0-978e-4fd8-b89a-725780592523 service nova] Creating event network-vif-plugged:2931da67-7e8b-43c4-9fbb-3adba1b7225a for instance 755c0b10-e04a-42fa-86da-8cc65537315d on hv-cinder-84713 Jun 22 10:25:36.287034 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-302c2ba8-1846-41b5-8535-3f636c455a59 req-f27cb7a0-978e-4fd8-b89a-725780592523 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044977 Jun 22 10:25:36.287877 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 229/480] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:25:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:25:36.716321 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-1efe6860-1299-49c0-b891-9890d8a916a0 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:36.717027 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-1efe6860-1299-49c0-b891-9890d8a916a0 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: da28df11-c078-43d5-81c4-e78ccf9f6504] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:36.723723 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1efe6860-1299-49c0-b891-9890d8a916a0 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:36.724179 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1efe6860-1299-49c0-b891-9890d8a916a0 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:36.724933 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1efe6860-1299-49c0-b891-9890d8a916a0 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:36.725375 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1efe6860-1299-49c0-b891-9890d8a916a0 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:36.880829 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-56022c3c-2426-4887-938a-d7cd56611c94 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:36.881692 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-56022c3c-2426-4887-938a-d7cd56611c94 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:36.888119 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-56022c3c-2426-4887-938a-d7cd56611c94 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:36.888572 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-56022c3c-2426-4887-938a-d7cd56611c94 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:36.889482 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-56022c3c-2426-4887-938a-d7cd56611c94 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:36.889921 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-56022c3c-2426-4887-938a-d7cd56611c94 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:36.934057 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-1efe6860-1299-49c0-b891-9890d8a916a0 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:36.944529 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-1efe6860-1299-49c0-b891-9890d8a916a0 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504" status: 200 len: 1724 microversion: 2.1 time: 0.232646 Jun 22 10:25:36.945863 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 252/481] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:36 2022] GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504 => generated 1724 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:25:37.083919 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-56022c3c-2426-4887-938a-d7cd56611c94 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:37.092025 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-56022c3c-2426-4887-938a-d7cd56611c94 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:37.093677 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-56022c3c-2426-4887-938a-d7cd56611c94 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:37.094859 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-56022c3c-2426-4887-938a-d7cd56611c94 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1745 microversion: 2.20 time: 0.218951 Jun 22 10:25:37.095631 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 230/482] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:25:36 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1745 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:25:37.486986 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-d54e3da4-8315-4dea-890a-b511b7b27227 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1477664418", "imageRef": "58addf50-5317-403a-beb0-4760bdbcaa13", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "09887ec6-fdf3-4f5d-9b2b-0fe6b3011cfb"}], "security_groups": [{"name": "tempest-securitygroup--360589722"}], "key_name": "tempest-keypair-1375683674", "user_data": "}} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:25:37.599394 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.network.neutron [None req-d54e3da4-8315-4dea-890a-b511b7b27227 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] validate_networks() for [('09887ec6-fdf3-4f5d-9b2b-0fe6b3011cfb', None, None, None, None, None)] {{(pid=117680) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 10:25:37.961339 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-55968dbd-38ba-4928-a9ce-cf378a6b939a tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:37.961935 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-55968dbd-38ba-4928-a9ce-cf378a6b939a tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: da28df11-c078-43d5-81c4-e78ccf9f6504] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:37.969329 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-55968dbd-38ba-4928-a9ce-cf378a6b939a tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:37.969783 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-55968dbd-38ba-4928-a9ce-cf378a6b939a tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:37.970588 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-55968dbd-38ba-4928-a9ce-cf378a6b939a tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:37.971006 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-55968dbd-38ba-4928-a9ce-cf378a6b939a tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:37.987895 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-d54e3da4-8315-4dea-890a-b511b7b27227 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Flavor limits 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 10:25:37.988395 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-d54e3da4-8315-4dea-890a-b511b7b27227 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Image limits 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 10:25:37.989025 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-d54e3da4-8315-4dea-890a-b511b7b27227 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Flavor pref 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 10:25:37.989513 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-d54e3da4-8315-4dea-890a-b511b7b27227 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Image pref 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 10:25:37.989994 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-d54e3da4-8315-4dea-890a-b511b7b27227 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 10:25:37.999387 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d54e3da4-8315-4dea-890a-b511b7b27227 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:37.999825 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d54e3da4-8315-4dea-890a-b511b7b27227 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:38.000612 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d54e3da4-8315-4dea-890a-b511b7b27227 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:38.001037 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d54e3da4-8315-4dea-890a-b511b7b27227 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:38.017942 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.quota [None req-d54e3da4-8315-4dea-890a-b511b7b27227 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Getting quotas for project 1db3fe97f51f47a98da3cbc8f0d55741. Resources: {'instances', 'cores', 'ram'} {{(pid=117680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:25:38.022130 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.quota [None req-d54e3da4-8315-4dea-890a-b511b7b27227 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Getting quotas for user da80b9a52feb462faf0469f2ab701fb8 and project 1db3fe97f51f47a98da3cbc8f0d55741. Resources: {'instances', 'cores', 'ram'} {{(pid=117680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:25:38.033709 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-d54e3da4-8315-4dea-890a-b511b7b27227 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Going to run 1 instances... {{(pid=117680) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 10:25:38.036098 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-d54e3da4-8315-4dea-890a-b511b7b27227 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: 752de513-d1ba-43b2-b68d-912134b1d215] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58addf50-5317-403a-beb0-4760bdbcaa13',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 10:25:38.082916 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-d54e3da4-8315-4dea-890a-b511b7b27227 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.600341 Jun 22 10:25:38.083881 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 253/483] 10.222.0.66 () {60 vars in 1146 bytes} [Wed Jun 22 10:25:37 2022] POST /compute/v2.1/servers => generated 401 bytes in 602 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 10:25:38.094043 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-d8332966-94f8-49b1-a12c-44a1fce9be54 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:38.094841 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-d8332966-94f8-49b1-a12c-44a1fce9be54 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: 752de513-d1ba-43b2-b68d-912134b1d215] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:38.103413 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-55968dbd-38ba-4928-a9ce-cf378a6b939a tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:38.123252 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-55968dbd-38ba-4928-a9ce-cf378a6b939a tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504" status: 200 len: 1724 microversion: 2.1 time: 0.165776 Jun 22 10:25:38.124334 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 231/484] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:37 2022] GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:25:38.129237 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-b68aa6f3-4d24-4530-9811-3a45c2e5ce89 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:38.130051 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-b68aa6f3-4d24-4530-9811-3a45c2e5ce89 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:38.136587 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b68aa6f3-4d24-4530-9811-3a45c2e5ce89 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:38.137043 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b68aa6f3-4d24-4530-9811-3a45c2e5ce89 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:38.137878 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b68aa6f3-4d24-4530-9811-3a45c2e5ce89 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:38.138313 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b68aa6f3-4d24-4530-9811-3a45c2e5ce89 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:38.160699 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-d8332966-94f8-49b1-a12c-44a1fce9be54 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:38.169411 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-d8332966-94f8-49b1-a12c-44a1fce9be54 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/752de513-d1ba-43b2-b68d-912134b1d215" status: 200 len: 1242 microversion: 2.1 time: 0.078683 Jun 22 10:25:38.170476 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 254/485] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:38 2022] GET /compute/v2.1/servers/752de513-d1ba-43b2-b68d-912134b1d215 => generated 1242 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:25:38.289693 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-b68aa6f3-4d24-4530-9811-3a45c2e5ce89 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:38.298523 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-b68aa6f3-4d24-4530-9811-3a45c2e5ce89 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:38.300237 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-b68aa6f3-4d24-4530-9811-3a45c2e5ce89 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:38.301625 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-b68aa6f3-4d24-4530-9811-3a45c2e5ce89 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1745 microversion: 2.20 time: 0.176204 Jun 22 10:25:38.302174 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 232/486] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:25:38 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1745 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:25:39.140782 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-dfc4160f-af5b-4900-9b3a-3a471e9949ba tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:39.142594 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-dfc4160f-af5b-4900-9b3a-3a471e9949ba tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: da28df11-c078-43d5-81c4-e78ccf9f6504] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:39.147775 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:25:39.153098 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-dfc4160f-af5b-4900-9b3a-3a471e9949ba tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:39.153848 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-dfc4160f-af5b-4900-9b3a-3a471e9949ba tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:39.155183 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-dfc4160f-af5b-4900-9b3a-3a471e9949ba tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:39.155818 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-dfc4160f-af5b-4900-9b3a-3a471e9949ba tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:39.192676 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-52c7ec7b-0406-40e0-aad4-a58e30a45b57 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:39.194978 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-52c7ec7b-0406-40e0-aad4-a58e30a45b57 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: 752de513-d1ba-43b2-b68d-912134b1d215] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:39.208291 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-52c7ec7b-0406-40e0-aad4-a58e30a45b57 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:39.208963 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-52c7ec7b-0406-40e0-aad4-a58e30a45b57 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:39.209896 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-52c7ec7b-0406-40e0-aad4-a58e30a45b57 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:39.210483 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-52c7ec7b-0406-40e0-aad4-a58e30a45b57 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:39.307974 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-52c7ec7b-0406-40e0-aad4-a58e30a45b57 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:39.316803 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-52c7ec7b-0406-40e0-aad4-a58e30a45b57 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/752de513-d1ba-43b2-b68d-912134b1d215" status: 200 len: 1312 microversion: 2.1 time: 0.130902 Jun 22 10:25:39.317285 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 233/487] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:39 2022] GET /compute/v2.1/servers/752de513-d1ba-43b2-b68d-912134b1d215 => generated 1312 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:25:39.322035 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-99df3b12-a8e0-48ae-94d2-6da2e90fcf79 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:39.322665 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-99df3b12-a8e0-48ae-94d2-6da2e90fcf79 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:39.330958 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-99df3b12-a8e0-48ae-94d2-6da2e90fcf79 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:39.331407 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-99df3b12-a8e0-48ae-94d2-6da2e90fcf79 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:39.332177 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-99df3b12-a8e0-48ae-94d2-6da2e90fcf79 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:39.332610 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-99df3b12-a8e0-48ae-94d2-6da2e90fcf79 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:39.427742 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-dfc4160f-af5b-4900-9b3a-3a471e9949ba tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:39.436254 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-dfc4160f-af5b-4900-9b3a-3a471e9949ba tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504" status: 200 len: 1724 microversion: 2.1 time: 0.299225 Jun 22 10:25:39.437220 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 255/488] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:39 2022] GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504 => generated 1724 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:25:39.494758 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-99df3b12-a8e0-48ae-94d2-6da2e90fcf79 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:39.504837 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-99df3b12-a8e0-48ae-94d2-6da2e90fcf79 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:39.506317 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-99df3b12-a8e0-48ae-94d2-6da2e90fcf79 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:39.507504 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-99df3b12-a8e0-48ae-94d2-6da2e90fcf79 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1745 microversion: 2.20 time: 0.189192 Jun 22 10:25:39.508036 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 234/489] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:25:39 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1745 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:25:40.333191 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-d0088d4b-693f-40bf-8ec9-e909ee5635b8 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:40.333937 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-d0088d4b-693f-40bf-8ec9-e909ee5635b8 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: 752de513-d1ba-43b2-b68d-912134b1d215] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:40.340776 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d0088d4b-693f-40bf-8ec9-e909ee5635b8 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:40.341222 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d0088d4b-693f-40bf-8ec9-e909ee5635b8 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:40.342116 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d0088d4b-693f-40bf-8ec9-e909ee5635b8 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:40.345869 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d0088d4b-693f-40bf-8ec9-e909ee5635b8 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:40.456793 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-8262ffbd-ae70-4bca-b9fd-007ddd6031e8 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:40.458307 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-8262ffbd-ae70-4bca-b9fd-007ddd6031e8 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: da28df11-c078-43d5-81c4-e78ccf9f6504] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:40.465168 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8262ffbd-ae70-4bca-b9fd-007ddd6031e8 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:40.465924 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8262ffbd-ae70-4bca-b9fd-007ddd6031e8 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:40.466726 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8262ffbd-ae70-4bca-b9fd-007ddd6031e8 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:40.467259 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8262ffbd-ae70-4bca-b9fd-007ddd6031e8 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:40.654743 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-d0088d4b-693f-40bf-8ec9-e909ee5635b8 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:40.665393 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-d0088d4b-693f-40bf-8ec9-e909ee5635b8 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/752de513-d1ba-43b2-b68d-912134b1d215" status: 200 len: 1367 microversion: 2.1 time: 0.336084 Jun 22 10:25:40.665986 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 256/490] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:40 2022] GET /compute/v2.1/servers/752de513-d1ba-43b2-b68d-912134b1d215 => generated 1367 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:25:40.673693 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-41a7b772-acba-4719-a246-7939b138cda3 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:40.674299 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-41a7b772-acba-4719-a246-7939b138cda3 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:40.681589 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-41a7b772-acba-4719-a246-7939b138cda3 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:40.682037 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-41a7b772-acba-4719-a246-7939b138cda3 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:40.682832 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-41a7b772-acba-4719-a246-7939b138cda3 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:40.683331 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-41a7b772-acba-4719-a246-7939b138cda3 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:40.747563 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-8262ffbd-ae70-4bca-b9fd-007ddd6031e8 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:40.758128 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-8262ffbd-ae70-4bca-b9fd-007ddd6031e8 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504" status: 200 len: 1701 microversion: 2.1 time: 0.305774 Jun 22 10:25:40.759242 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 235/491] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:40 2022] GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504 => generated 1701 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:25:40.775376 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-87be74e3-7dfb-4ba3-9c02-5a680d613d8f tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:25:40.782833 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-87be74e3-7dfb-4ba3-9c02-5a680d613d8f tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:40.783722 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-87be74e3-7dfb-4ba3-9c02-5a680d613d8f tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:40.818493 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-87be74e3-7dfb-4ba3-9c02-5a680d613d8f tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: da28df11-c078-43d5-81c4-e78ccf9f6504] Going to try to start instance {{(pid=117679) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 22 10:25:40.906678 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-87be74e3-7dfb-4ba3-9c02-5a680d613d8f tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "POST /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504/action" status: 202 len: 0 microversion: 2.1 time: 0.135091 Jun 22 10:25:40.910236 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 236/492] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Jun 22 10:25:40 2022] POST /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:25:40.920042 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-3dbceb07-ff48-4be3-88cc-91c104346da3 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:40.921230 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-3dbceb07-ff48-4be3-88cc-91c104346da3 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: da28df11-c078-43d5-81c4-e78ccf9f6504] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:40.934705 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3dbceb07-ff48-4be3-88cc-91c104346da3 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:40.936480 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3dbceb07-ff48-4be3-88cc-91c104346da3 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:40.937495 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3dbceb07-ff48-4be3-88cc-91c104346da3 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:40.938083 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3dbceb07-ff48-4be3-88cc-91c104346da3 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:41.000357 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-41a7b772-acba-4719-a246-7939b138cda3 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:41.013378 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-41a7b772-acba-4719-a246-7939b138cda3 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:41.025932 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-41a7b772-acba-4719-a246-7939b138cda3 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:41.028475 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-41a7b772-acba-4719-a246-7939b138cda3 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1740 microversion: 2.20 time: 0.361271 Jun 22 10:25:41.031728 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 257/493] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:25:40 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1740 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:25:41.219147 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-3dbceb07-ff48-4be3-88cc-91c104346da3 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:41.235871 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-3dbceb07-ff48-4be3-88cc-91c104346da3 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504" status: 200 len: 1710 microversion: 2.1 time: 0.320718 Jun 22 10:25:41.236585 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 237/494] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:40 2022] GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504 => generated 1710 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:25:41.343671 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-62d44dfb-dbfa-427f-9da9-687a4b982c1f req-0ea0d9a2-4297-4154-9ab2-7f7808f44b6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "752de513-d1ba-43b2-b68d-912134b1d215", "tag": "57150168-15e9-4d54-980f-4f45dc8ded4a"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:25:41.358636 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-62d44dfb-dbfa-427f-9da9-687a4b982c1f req-0ea0d9a2-4297-4154-9ab2-7f7808f44b6e service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:41.361484 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-62d44dfb-dbfa-427f-9da9-687a4b982c1f req-0ea0d9a2-4297-4154-9ab2-7f7808f44b6e service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:41.391728 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-62d44dfb-dbfa-427f-9da9-687a4b982c1f req-0ea0d9a2-4297-4154-9ab2-7f7808f44b6e service nova] Creating event network-changed:57150168-15e9-4d54-980f-4f45dc8ded4a for instance 752de513-d1ba-43b2-b68d-912134b1d215 on hv-cinder-84713 Jun 22 10:25:41.405320 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-62d44dfb-dbfa-427f-9da9-687a4b982c1f req-0ea0d9a2-4297-4154-9ab2-7f7808f44b6e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064239 Jun 22 10:25:41.407276 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 258/495] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:25:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:25:41.687345 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-0e1a88e8-adcc-4738-9b1c-e1468efa79e8 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:41.688731 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-0e1a88e8-adcc-4738-9b1c-e1468efa79e8 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: 752de513-d1ba-43b2-b68d-912134b1d215] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:41.693563 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_api:SELECT=54 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:25:41.700624 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0e1a88e8-adcc-4738-9b1c-e1468efa79e8 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:41.701413 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0e1a88e8-adcc-4738-9b1c-e1468efa79e8 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:41.702397 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0e1a88e8-adcc-4738-9b1c-e1468efa79e8 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:41.702998 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0e1a88e8-adcc-4738-9b1c-e1468efa79e8 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:42.055743 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-547dc9d1-143f-4d01-86fb-bd71ee45d6a3 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:42.056751 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-547dc9d1-143f-4d01-86fb-bd71ee45d6a3 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:42.068367 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-547dc9d1-143f-4d01-86fb-bd71ee45d6a3 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:42.070064 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-547dc9d1-143f-4d01-86fb-bd71ee45d6a3 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:42.071196 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-547dc9d1-143f-4d01-86fb-bd71ee45d6a3 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:42.071810 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-547dc9d1-143f-4d01-86fb-bd71ee45d6a3 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:42.270585 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-0e1a88e8-adcc-4738-9b1c-e1468efa79e8 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:42.278374 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-0e1a88e8-adcc-4738-9b1c-e1468efa79e8 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/752de513-d1ba-43b2-b68d-912134b1d215" status: 200 len: 1367 microversion: 2.1 time: 0.597133 Jun 22 10:25:42.287196 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 238/496] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:41 2022] GET /compute/v2.1/servers/752de513-d1ba-43b2-b68d-912134b1d215 => generated 1367 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:25:42.292363 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-0beb1e46-f644-4849-93e7-01c87b21e970 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:42.293048 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-0beb1e46-f644-4849-93e7-01c87b21e970 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: da28df11-c078-43d5-81c4-e78ccf9f6504] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:42.300769 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0beb1e46-f644-4849-93e7-01c87b21e970 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:42.301215 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0beb1e46-f644-4849-93e7-01c87b21e970 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:42.301990 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0beb1e46-f644-4849-93e7-01c87b21e970 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:42.302428 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0beb1e46-f644-4849-93e7-01c87b21e970 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:42.372236 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-547dc9d1-143f-4d01-86fb-bd71ee45d6a3 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:42.382147 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-547dc9d1-143f-4d01-86fb-bd71ee45d6a3 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:42.383948 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-547dc9d1-143f-4d01-86fb-bd71ee45d6a3 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:42.385315 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-547dc9d1-143f-4d01-86fb-bd71ee45d6a3 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1740 microversion: 2.20 time: 0.335563 Jun 22 10:25:42.385871 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 259/497] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:25:42 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1740 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:25:42.489705 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-0beb1e46-f644-4849-93e7-01c87b21e970 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:42.504401 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-0beb1e46-f644-4849-93e7-01c87b21e970 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504" status: 200 len: 1710 microversion: 2.1 time: 0.215901 Jun 22 10:25:42.505298 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 239/498] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:42 2022] GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504 => generated 1710 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:25:43.295792 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-15f0c9e3-0e15-4907-a910-2c8a95a81c3f tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:43.296614 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-15f0c9e3-0e15-4907-a910-2c8a95a81c3f tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: 752de513-d1ba-43b2-b68d-912134b1d215] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:43.305507 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-15f0c9e3-0e15-4907-a910-2c8a95a81c3f tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:43.305962 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-15f0c9e3-0e15-4907-a910-2c8a95a81c3f tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:43.306905 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-15f0c9e3-0e15-4907-a910-2c8a95a81c3f tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:43.307335 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-15f0c9e3-0e15-4907-a910-2c8a95a81c3f tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:43.406881 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-de629ba6-7b61-472a-93c5-e23080d773a7 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:43.407990 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-de629ba6-7b61-472a-93c5-e23080d773a7 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:43.416318 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-de629ba6-7b61-472a-93c5-e23080d773a7 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:43.416764 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-de629ba6-7b61-472a-93c5-e23080d773a7 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:43.417543 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-de629ba6-7b61-472a-93c5-e23080d773a7 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:43.417973 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-de629ba6-7b61-472a-93c5-e23080d773a7 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:43.456169 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-15f0c9e3-0e15-4907-a910-2c8a95a81c3f tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:43.464562 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-15f0c9e3-0e15-4907-a910-2c8a95a81c3f tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/752de513-d1ba-43b2-b68d-912134b1d215" status: 200 len: 1367 microversion: 2.1 time: 0.172947 Jun 22 10:25:43.465814 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 260/499] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:43 2022] GET /compute/v2.1/servers/752de513-d1ba-43b2-b68d-912134b1d215 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:25:43.523899 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-a3be161d-5caf-400b-9e74-fcbc17391ad0 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:43.524619 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-a3be161d-5caf-400b-9e74-fcbc17391ad0 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: da28df11-c078-43d5-81c4-e78ccf9f6504] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:43.532041 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a3be161d-5caf-400b-9e74-fcbc17391ad0 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:43.532741 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a3be161d-5caf-400b-9e74-fcbc17391ad0 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:43.533516 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a3be161d-5caf-400b-9e74-fcbc17391ad0 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:43.534105 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a3be161d-5caf-400b-9e74-fcbc17391ad0 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:43.565016 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-de629ba6-7b61-472a-93c5-e23080d773a7 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:43.573321 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-de629ba6-7b61-472a-93c5-e23080d773a7 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:43.576429 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-de629ba6-7b61-472a-93c5-e23080d773a7 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:43.577613 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-de629ba6-7b61-472a-93c5-e23080d773a7 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1740 microversion: 2.20 time: 0.176132 Jun 22 10:25:43.578145 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 240/500] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:25:43 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1740 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:25:43.703061 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-a3be161d-5caf-400b-9e74-fcbc17391ad0 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:43.711961 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-a3be161d-5caf-400b-9e74-fcbc17391ad0 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504" status: 200 len: 1710 microversion: 2.1 time: 0.192305 Jun 22 10:25:43.712532 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 261/501] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:43 2022] GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504 => generated 1710 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:25:44.481772 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-94411b44-3faf-4baf-a74a-d0e8c2ba621f tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:44.482376 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-94411b44-3faf-4baf-a74a-d0e8c2ba621f tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: 752de513-d1ba-43b2-b68d-912134b1d215] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:44.489615 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-94411b44-3faf-4baf-a74a-d0e8c2ba621f tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:44.490066 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-94411b44-3faf-4baf-a74a-d0e8c2ba621f tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:44.490848 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-94411b44-3faf-4baf-a74a-d0e8c2ba621f tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:44.491281 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-94411b44-3faf-4baf-a74a-d0e8c2ba621f tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:44.597648 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-adbc55dd-49f4-43c2-95ce-03d006136e8d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:44.598874 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-adbc55dd-49f4-43c2-95ce-03d006136e8d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:44.610017 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-adbc55dd-49f4-43c2-95ce-03d006136e8d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:44.610494 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-adbc55dd-49f4-43c2-95ce-03d006136e8d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:44.611334 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-adbc55dd-49f4-43c2-95ce-03d006136e8d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:44.611780 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-adbc55dd-49f4-43c2-95ce-03d006136e8d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:44.682331 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-94411b44-3faf-4baf-a74a-d0e8c2ba621f tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:44.692942 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-94411b44-3faf-4baf-a74a-d0e8c2ba621f tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/752de513-d1ba-43b2-b68d-912134b1d215" status: 200 len: 1367 microversion: 2.1 time: 0.215108 Jun 22 10:25:44.699794 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 241/502] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:44 2022] GET /compute/v2.1/servers/752de513-d1ba-43b2-b68d-912134b1d215 => generated 1367 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:25:44.729285 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-7baaab9c-499c-47d2-ad75-ee79ea8c246c tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:44.729893 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-7baaab9c-499c-47d2-ad75-ee79ea8c246c tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: da28df11-c078-43d5-81c4-e78ccf9f6504] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:44.736644 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7baaab9c-499c-47d2-ad75-ee79ea8c246c tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:44.737279 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7baaab9c-499c-47d2-ad75-ee79ea8c246c tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:44.738564 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7baaab9c-499c-47d2-ad75-ee79ea8c246c tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:44.739153 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7baaab9c-499c-47d2-ad75-ee79ea8c246c tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:44.760098 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:25:44.828559 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-adbc55dd-49f4-43c2-95ce-03d006136e8d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:44.837368 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-adbc55dd-49f4-43c2-95ce-03d006136e8d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:44.838860 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-adbc55dd-49f4-43c2-95ce-03d006136e8d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:44.840211 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-adbc55dd-49f4-43c2-95ce-03d006136e8d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1740 microversion: 2.20 time: 0.247736 Jun 22 10:25:44.840957 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 262/503] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:25:44 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1740 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:25:44.896197 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-7baaab9c-499c-47d2-ad75-ee79ea8c246c tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:44.905011 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-7baaab9c-499c-47d2-ad75-ee79ea8c246c tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504" status: 200 len: 1710 microversion: 2.1 time: 0.179510 Jun 22 10:25:44.905588 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 242/504] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:44 2022] GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504 => generated 1710 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:25:45.719942 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-4cf7207f-42f0-4bcd-af5b-d64b18468990 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:45.720537 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-4cf7207f-42f0-4bcd-af5b-d64b18468990 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: 752de513-d1ba-43b2-b68d-912134b1d215] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:45.727503 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4cf7207f-42f0-4bcd-af5b-d64b18468990 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:45.728297 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4cf7207f-42f0-4bcd-af5b-d64b18468990 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:45.729349 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4cf7207f-42f0-4bcd-af5b-d64b18468990 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:45.730004 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4cf7207f-42f0-4bcd-af5b-d64b18468990 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:45.823726 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 10:25:45.824218 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Wed Jun 22 10:25:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 10:25:45.858975 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-f06c4806-dcf8-40a4-b515-3a033e43e192 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:45.860307 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-f06c4806-dcf8-40a4-b515-3a033e43e192 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:45.869068 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f06c4806-dcf8-40a4-b515-3a033e43e192 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:45.869507 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f06c4806-dcf8-40a4-b515-3a033e43e192 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:45.870312 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f06c4806-dcf8-40a4-b515-3a033e43e192 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:45.870773 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f06c4806-dcf8-40a4-b515-3a033e43e192 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:45.888144 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-4cf7207f-42f0-4bcd-af5b-d64b18468990 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:45.898555 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-4cf7207f-42f0-4bcd-af5b-d64b18468990 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/752de513-d1ba-43b2-b68d-912134b1d215" status: 200 len: 1367 microversion: 2.1 time: 0.183093 Jun 22 10:25:45.899370 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 263/505] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:45 2022] GET /compute/v2.1/servers/752de513-d1ba-43b2-b68d-912134b1d215 => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:25:45.923158 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-4e8c538f-ed36-45e7-a892-ebcfe3150d61 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:45.923755 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-4e8c538f-ed36-45e7-a892-ebcfe3150d61 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: da28df11-c078-43d5-81c4-e78ccf9f6504] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:45.930297 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4e8c538f-ed36-45e7-a892-ebcfe3150d61 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:45.930775 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4e8c538f-ed36-45e7-a892-ebcfe3150d61 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:45.931556 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4e8c538f-ed36-45e7-a892-ebcfe3150d61 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:45.931988 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4e8c538f-ed36-45e7-a892-ebcfe3150d61 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:46.103823 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-4e8c538f-ed36-45e7-a892-ebcfe3150d61 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:46.113816 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-4e8c538f-ed36-45e7-a892-ebcfe3150d61 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504" status: 200 len: 1710 microversion: 2.1 time: 0.195017 Jun 22 10:25:46.125243 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 264/506] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:45 2022] GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504 => generated 1710 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:25:46.156164 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-f06c4806-dcf8-40a4-b515-3a033e43e192 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:46.165200 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-f06c4806-dcf8-40a4-b515-3a033e43e192 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:46.166957 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-f06c4806-dcf8-40a4-b515-3a033e43e192 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:46.168289 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-f06c4806-dcf8-40a4-b515-3a033e43e192 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1740 microversion: 2.20 time: 0.313718 Jun 22 10:25:46.169454 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 243/507] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:25:45 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1740 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:25:46.710052 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 10:25:46.710265 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Wed Jun 22 10:25:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 10:25:46.916314 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-fce78fa1-5c0d-4579-bb23-aecf1af5e29f tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:46.916915 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-fce78fa1-5c0d-4579-bb23-aecf1af5e29f tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: 752de513-d1ba-43b2-b68d-912134b1d215] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:46.926821 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fce78fa1-5c0d-4579-bb23-aecf1af5e29f tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:46.932254 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fce78fa1-5c0d-4579-bb23-aecf1af5e29f tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:46.933293 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fce78fa1-5c0d-4579-bb23-aecf1af5e29f tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:46.933730 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fce78fa1-5c0d-4579-bb23-aecf1af5e29f tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:47.132418 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-2bd18553-8504-457c-b88e-eab5bf8496cd tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:47.133352 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-2bd18553-8504-457c-b88e-eab5bf8496cd tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: da28df11-c078-43d5-81c4-e78ccf9f6504] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:47.140383 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2bd18553-8504-457c-b88e-eab5bf8496cd tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:47.140954 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2bd18553-8504-457c-b88e-eab5bf8496cd tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:47.141726 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2bd18553-8504-457c-b88e-eab5bf8496cd tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:47.142160 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2bd18553-8504-457c-b88e-eab5bf8496cd tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:47.268295 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-fce78fa1-5c0d-4579-bb23-aecf1af5e29f tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:47.275942 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-fce78fa1-5c0d-4579-bb23-aecf1af5e29f tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/752de513-d1ba-43b2-b68d-912134b1d215" status: 200 len: 1367 microversion: 2.1 time: 0.363592 Jun 22 10:25:47.285629 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 265/508] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:46 2022] GET /compute/v2.1/servers/752de513-d1ba-43b2-b68d-912134b1d215 => generated 1367 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:25:47.290259 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-2d227f06-3a68-4133-9ed4-0b885fd9fc63 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:47.290909 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-2d227f06-3a68-4133-9ed4-0b885fd9fc63 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:47.297253 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2d227f06-3a68-4133-9ed4-0b885fd9fc63 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:47.297817 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2d227f06-3a68-4133-9ed4-0b885fd9fc63 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:47.298489 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2d227f06-3a68-4133-9ed4-0b885fd9fc63 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:47.298952 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2d227f06-3a68-4133-9ed4-0b885fd9fc63 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:47.577791 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-2bd18553-8504-457c-b88e-eab5bf8496cd tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:47.587482 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-2bd18553-8504-457c-b88e-eab5bf8496cd tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504" status: 200 len: 1714 microversion: 2.1 time: 0.459581 Jun 22 10:25:47.594328 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 244/509] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:47 2022] GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504 => generated 1714 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:25:47.659861 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-2d227f06-3a68-4133-9ed4-0b885fd9fc63 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:47.680058 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-2d227f06-3a68-4133-9ed4-0b885fd9fc63 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:47.681985 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-2d227f06-3a68-4133-9ed4-0b885fd9fc63 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:47.685178 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-2d227f06-3a68-4133-9ed4-0b885fd9fc63 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1740 microversion: 2.20 time: 0.398695 Jun 22 10:25:47.686167 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 266/510] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:25:47 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1740 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:25:48.293890 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-e998b5ba-f44b-4e1e-937f-2f7f267cc3e2 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:48.294493 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-e998b5ba-f44b-4e1e-937f-2f7f267cc3e2 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: 752de513-d1ba-43b2-b68d-912134b1d215] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:48.301243 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e998b5ba-f44b-4e1e-937f-2f7f267cc3e2 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:48.301768 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e998b5ba-f44b-4e1e-937f-2f7f267cc3e2 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:48.302673 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e998b5ba-f44b-4e1e-937f-2f7f267cc3e2 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:48.303288 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e998b5ba-f44b-4e1e-937f-2f7f267cc3e2 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:48.465657 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-e998b5ba-f44b-4e1e-937f-2f7f267cc3e2 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:48.475567 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-e998b5ba-f44b-4e1e-937f-2f7f267cc3e2 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/752de513-d1ba-43b2-b68d-912134b1d215" status: 200 len: 1367 microversion: 2.1 time: 0.185926 Jun 22 10:25:48.476161 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 245/511] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:48 2022] GET /compute/v2.1/servers/752de513-d1ba-43b2-b68d-912134b1d215 => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:25:48.674200 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-4d916cdb-0407-4a08-9648-01a445bd50b0 req-5432b3d0-65ab-497e-9da4-4ccdbfbd8f8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "752de513-d1ba-43b2-b68d-912134b1d215", "name": "network-vif-plugged", "status": "completed", "tag": "57150168-15e9-4d54-980f-4f45dc8ded4a"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:25:48.678437 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell0:SELECT=2 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:25:48.679870 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell0:SELECT=12 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:25:48.704420 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-d0116b5d-3d2f-44c0-8d6d-df24187d3c8d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:48.705032 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-d0116b5d-3d2f-44c0-8d6d-df24187d3c8d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:48.721841 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d0116b5d-3d2f-44c0-8d6d-df24187d3c8d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:48.722644 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d0116b5d-3d2f-44c0-8d6d-df24187d3c8d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:48.723384 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-4d916cdb-0407-4a08-9648-01a445bd50b0 req-5432b3d0-65ab-497e-9da4-4ccdbfbd8f8a service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:48.723512 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d0116b5d-3d2f-44c0-8d6d-df24187d3c8d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:48.723882 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d0116b5d-3d2f-44c0-8d6d-df24187d3c8d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:48.724096 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-4d916cdb-0407-4a08-9648-01a445bd50b0 req-5432b3d0-65ab-497e-9da4-4ccdbfbd8f8a service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:48.743161 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-4d916cdb-0407-4a08-9648-01a445bd50b0 req-5432b3d0-65ab-497e-9da4-4ccdbfbd8f8a service nova] Creating event network-vif-plugged:57150168-15e9-4d54-980f-4f45dc8ded4a for instance 752de513-d1ba-43b2-b68d-912134b1d215 on hv-cinder-84713 Jun 22 10:25:48.752529 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-4d916cdb-0407-4a08-9648-01a445bd50b0 req-5432b3d0-65ab-497e-9da4-4ccdbfbd8f8a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084560 Jun 22 10:25:48.753308 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 267/512] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:25:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:25:48.897952 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-d0116b5d-3d2f-44c0-8d6d-df24187d3c8d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:48.919566 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-d0116b5d-3d2f-44c0-8d6d-df24187d3c8d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:48.921247 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-d0116b5d-3d2f-44c0-8d6d-df24187d3c8d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:48.922685 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-d0116b5d-3d2f-44c0-8d6d-df24187d3c8d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1740 microversion: 2.20 time: 0.222362 Jun 22 10:25:48.923408 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 246/513] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:25:48 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1740 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:25:49.493335 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-76995ed3-d1e0-4b7d-91c5-96d403ab95e8 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:49.494346 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-76995ed3-d1e0-4b7d-91c5-96d403ab95e8 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: 752de513-d1ba-43b2-b68d-912134b1d215] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:49.501992 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-76995ed3-d1e0-4b7d-91c5-96d403ab95e8 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:49.502714 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-76995ed3-d1e0-4b7d-91c5-96d403ab95e8 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:49.503672 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-76995ed3-d1e0-4b7d-91c5-96d403ab95e8 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:49.504265 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-76995ed3-d1e0-4b7d-91c5-96d403ab95e8 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:49.662124 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-76995ed3-d1e0-4b7d-91c5-96d403ab95e8 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:49.665726 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:SELECT=100 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:25:49.674939 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-76995ed3-d1e0-4b7d-91c5-96d403ab95e8 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/752de513-d1ba-43b2-b68d-912134b1d215" status: 200 len: 1367 microversion: 2.1 time: 0.181638 Jun 22 10:25:49.676188 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 268/514] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:49 2022] GET /compute/v2.1/servers/752de513-d1ba-43b2-b68d-912134b1d215 => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:25:49.943647 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-8643e7ba-8d3f-4f11-af26-5721333c1018 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:49.944258 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-8643e7ba-8d3f-4f11-af26-5721333c1018 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:49.950651 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8643e7ba-8d3f-4f11-af26-5721333c1018 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:49.951131 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8643e7ba-8d3f-4f11-af26-5721333c1018 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:49.951934 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8643e7ba-8d3f-4f11-af26-5721333c1018 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:49.952360 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8643e7ba-8d3f-4f11-af26-5721333c1018 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:50.083020 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-8643e7ba-8d3f-4f11-af26-5721333c1018 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:50.091698 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-8643e7ba-8d3f-4f11-af26-5721333c1018 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:50.093220 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-8643e7ba-8d3f-4f11-af26-5721333c1018 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:50.094574 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-8643e7ba-8d3f-4f11-af26-5721333c1018 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1740 microversion: 2.20 time: 0.155408 Jun 22 10:25:50.105146 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 247/515] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:25:49 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1740 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:25:50.692947 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-e96b4332-132e-47cf-93bb-15d846827e47 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:50.693555 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-e96b4332-132e-47cf-93bb-15d846827e47 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: 752de513-d1ba-43b2-b68d-912134b1d215] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:50.700635 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e96b4332-132e-47cf-93bb-15d846827e47 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:50.701089 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e96b4332-132e-47cf-93bb-15d846827e47 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:50.702099 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e96b4332-132e-47cf-93bb-15d846827e47 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:50.702700 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e96b4332-132e-47cf-93bb-15d846827e47 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:50.852327 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-e96b4332-132e-47cf-93bb-15d846827e47 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:50.861111 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-e96b4332-132e-47cf-93bb-15d846827e47 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/752de513-d1ba-43b2-b68d-912134b1d215" status: 200 len: 1367 microversion: 2.1 time: 0.172282 Jun 22 10:25:50.870388 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 269/516] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:50 2022] GET /compute/v2.1/servers/752de513-d1ba-43b2-b68d-912134b1d215 => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:25:51.113100 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-da94c154-2b06-4598-b112-d5086c503961 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:51.113903 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-da94c154-2b06-4598-b112-d5086c503961 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:51.120868 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-da94c154-2b06-4598-b112-d5086c503961 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:51.121321 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-da94c154-2b06-4598-b112-d5086c503961 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:51.122091 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-da94c154-2b06-4598-b112-d5086c503961 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:51.122542 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-da94c154-2b06-4598-b112-d5086c503961 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:51.262002 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-da94c154-2b06-4598-b112-d5086c503961 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:51.271501 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-da94c154-2b06-4598-b112-d5086c503961 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:51.273807 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-da94c154-2b06-4598-b112-d5086c503961 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:51.275104 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-da94c154-2b06-4598-b112-d5086c503961 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1740 microversion: 2.20 time: 0.166066 Jun 22 10:25:51.275659 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 248/517] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:25:51 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1740 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:25:51.939813 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-285fffba-8fdb-45d0-b992-4eca5bfc47f7 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:51.940511 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-285fffba-8fdb-45d0-b992-4eca5bfc47f7 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: 752de513-d1ba-43b2-b68d-912134b1d215] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:51.946805 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-285fffba-8fdb-45d0-b992-4eca5bfc47f7 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:51.947531 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-285fffba-8fdb-45d0-b992-4eca5bfc47f7 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:51.948637 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-285fffba-8fdb-45d0-b992-4eca5bfc47f7 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:51.949282 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-285fffba-8fdb-45d0-b992-4eca5bfc47f7 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:52.100211 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-285fffba-8fdb-45d0-b992-4eca5bfc47f7 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:52.109264 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-285fffba-8fdb-45d0-b992-4eca5bfc47f7 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/752de513-d1ba-43b2-b68d-912134b1d215" status: 200 len: 1558 microversion: 2.1 time: 0.235474 Jun 22 10:25:52.110283 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 270/518] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:25:51 2022] GET /compute/v2.1/servers/752de513-d1ba-43b2-b68d-912134b1d215 => generated 1558 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:25:52.126223 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-a5645824-8eac-48bf-86dd-85128090aea0 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:52.126822 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-a5645824-8eac-48bf-86dd-85128090aea0 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: 752de513-d1ba-43b2-b68d-912134b1d215] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:52.133401 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a5645824-8eac-48bf-86dd-85128090aea0 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:52.134120 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a5645824-8eac-48bf-86dd-85128090aea0 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:52.135084 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a5645824-8eac-48bf-86dd-85128090aea0 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:52.135513 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a5645824-8eac-48bf-86dd-85128090aea0 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:52.217241 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-a5645824-8eac-48bf-86dd-85128090aea0 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/752de513-d1ba-43b2-b68d-912134b1d215/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094920 Jun 22 10:25:52.223199 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 249/519] 10.222.0.66 () {58 vars in 1274 bytes} [Wed Jun 22 10:25:52 2022] GET /compute/v2.1/servers/752de513-d1ba-43b2-b68d-912134b1d215/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:25:52.293320 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-f2c81252-e0a0-4c74-91d1-daadbcbc49af tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:52.294212 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-f2c81252-e0a0-4c74-91d1-daadbcbc49af tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:52.301411 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f2c81252-e0a0-4c74-91d1-daadbcbc49af tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:52.301830 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f2c81252-e0a0-4c74-91d1-daadbcbc49af tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:52.302817 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f2c81252-e0a0-4c74-91d1-daadbcbc49af tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:52.303410 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f2c81252-e0a0-4c74-91d1-daadbcbc49af tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:52.531197 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-f2c81252-e0a0-4c74-91d1-daadbcbc49af tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:52.540325 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-f2c81252-e0a0-4c74-91d1-daadbcbc49af tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:52.541838 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-f2c81252-e0a0-4c74-91d1-daadbcbc49af tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:52.543757 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-f2c81252-e0a0-4c74-91d1-daadbcbc49af tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1740 microversion: 2.20 time: 0.254232 Jun 22 10:25:52.544739 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 271/520] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:25:52 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1740 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:25:53.518040 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-13732fa7-e025-428e-8e68-d3d56b3fc891 req-8cdce079-1390-40b2-abf8-dd4b522e1fe8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "752de513-d1ba-43b2-b68d-912134b1d215", "tag": "57150168-15e9-4d54-980f-4f45dc8ded4a"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:25:53.526119 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-13732fa7-e025-428e-8e68-d3d56b3fc891 req-8cdce079-1390-40b2-abf8-dd4b522e1fe8 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:53.526587 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-13732fa7-e025-428e-8e68-d3d56b3fc891 req-8cdce079-1390-40b2-abf8-dd4b522e1fe8 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:53.538146 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-13732fa7-e025-428e-8e68-d3d56b3fc891 req-8cdce079-1390-40b2-abf8-dd4b522e1fe8 service nova] Creating event network-changed:57150168-15e9-4d54-980f-4f45dc8ded4a for instance 752de513-d1ba-43b2-b68d-912134b1d215 on hv-cinder-84713 Jun 22 10:25:53.543498 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-13732fa7-e025-428e-8e68-d3d56b3fc891 req-8cdce079-1390-40b2-abf8-dd4b522e1fe8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029875 Jun 22 10:25:53.544116 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 250/521] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:25:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:25:53.564963 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-55ff325d-edac-46ca-ab80-993dae0057e9 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:53.565549 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-55ff325d-edac-46ca-ab80-993dae0057e9 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:53.572025 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-55ff325d-edac-46ca-ab80-993dae0057e9 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:53.572472 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-55ff325d-edac-46ca-ab80-993dae0057e9 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:53.573236 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-55ff325d-edac-46ca-ab80-993dae0057e9 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:53.573687 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-55ff325d-edac-46ca-ab80-993dae0057e9 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:53.809215 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-55ff325d-edac-46ca-ab80-993dae0057e9 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:53.817465 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-55ff325d-edac-46ca-ab80-993dae0057e9 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:53.819378 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-55ff325d-edac-46ca-ab80-993dae0057e9 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:53.820837 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-55ff325d-edac-46ca-ab80-993dae0057e9 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1722 microversion: 2.20 time: 0.259886 Jun 22 10:25:53.832201 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 272/522] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:25:53 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1722 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:25:54.841925 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-8ebd9cf9-210d-4921-b8ca-b5f6dc59df6c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:54.842679 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-8ebd9cf9-210d-4921-b8ca-b5f6dc59df6c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:54.849807 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8ebd9cf9-210d-4921-b8ca-b5f6dc59df6c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:54.850252 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8ebd9cf9-210d-4921-b8ca-b5f6dc59df6c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:54.851049 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8ebd9cf9-210d-4921-b8ca-b5f6dc59df6c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:54.851479 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8ebd9cf9-210d-4921-b8ca-b5f6dc59df6c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:54.989156 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-8ebd9cf9-210d-4921-b8ca-b5f6dc59df6c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:54.997548 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-8ebd9cf9-210d-4921-b8ca-b5f6dc59df6c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:54.999198 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-8ebd9cf9-210d-4921-b8ca-b5f6dc59df6c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:55.000370 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-8ebd9cf9-210d-4921-b8ca-b5f6dc59df6c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1722 microversion: 2.20 time: 0.163564 Jun 22 10:25:55.000948 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 251/523] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:25:54 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:25:56.021684 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-8fbef3c6-3fcb-408b-aadf-c14683264ca4 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:56.022266 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-8fbef3c6-3fcb-408b-aadf-c14683264ca4 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:56.031688 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8fbef3c6-3fcb-408b-aadf-c14683264ca4 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:56.032137 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8fbef3c6-3fcb-408b-aadf-c14683264ca4 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:56.032900 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8fbef3c6-3fcb-408b-aadf-c14683264ca4 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:56.033329 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8fbef3c6-3fcb-408b-aadf-c14683264ca4 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:56.168674 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-8fbef3c6-3fcb-408b-aadf-c14683264ca4 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:56.177569 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-8fbef3c6-3fcb-408b-aadf-c14683264ca4 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:56.179114 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-8fbef3c6-3fcb-408b-aadf-c14683264ca4 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:56.180286 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-8fbef3c6-3fcb-408b-aadf-c14683264ca4 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1722 microversion: 2.20 time: 0.164766 Jun 22 10:25:56.180858 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 273/524] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:25:56 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:25:57.198848 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-40f2cae7-aec2-4d47-82a2-074209c71f4f tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:57.199482 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-40f2cae7-aec2-4d47-82a2-074209c71f4f tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:57.206822 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-40f2cae7-aec2-4d47-82a2-074209c71f4f tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:57.207206 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-40f2cae7-aec2-4d47-82a2-074209c71f4f tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:57.207973 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-40f2cae7-aec2-4d47-82a2-074209c71f4f tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:57.208411 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-40f2cae7-aec2-4d47-82a2-074209c71f4f tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:57.358067 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-40f2cae7-aec2-4d47-82a2-074209c71f4f tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:57.366420 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-40f2cae7-aec2-4d47-82a2-074209c71f4f tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:57.367946 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-40f2cae7-aec2-4d47-82a2-074209c71f4f tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:57.369114 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-40f2cae7-aec2-4d47-82a2-074209c71f4f tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1665 microversion: 2.20 time: 0.174426 Jun 22 10:25:57.369721 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 252/525] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:25:57 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1665 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:25:57.395196 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-3f5131ab-94d5-4244-aaee-ad425fcf0ddd tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "486bb536-1840-459d-a4a9-4d5733c634b5"}} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:25:57.396561 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-3f5131ab-94d5-4244-aaee-ad425fcf0ddd tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:57.407339 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3f5131ab-94d5-4244-aaee-ad425fcf0ddd tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:57.408182 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3f5131ab-94d5-4244-aaee-ad425fcf0ddd tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:57.409370 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3f5131ab-94d5-4244-aaee-ad425fcf0ddd tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:57.409882 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3f5131ab-94d5-4244-aaee-ad425fcf0ddd tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:57.713308 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-3f5131ab-94d5-4244-aaee-ad425fcf0ddd tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "POST /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.324336 Jun 22 10:25:57.713925 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 274/526] 10.222.0.66 () {62 vars in 1363 bytes} [Wed Jun 22 10:25:57 2022] POST /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d/os-volume_attachments => generated 188 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 10:25:57.838645 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-4ef6ba7d-9d21-4a7f-972a-3583444a7288 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:25:57.839306 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-4ef6ba7d-9d21-4a7f-972a-3583444a7288 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:57.846218 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4ef6ba7d-9d21-4a7f-972a-3583444a7288 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:57.846703 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4ef6ba7d-9d21-4a7f-972a-3583444a7288 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:57.847469 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4ef6ba7d-9d21-4a7f-972a-3583444a7288 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:57.847899 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4ef6ba7d-9d21-4a7f-972a-3583444a7288 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:58.013905 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-4ef6ba7d-9d21-4a7f-972a-3583444a7288 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "POST /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d/action" status: 202 len: 0 microversion: 2.20 time: 0.178859 Jun 22 10:25:58.014439 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 253/527] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Jun 22 10:25:57 2022] POST /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 22 10:25:58.023244 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-5fe44ddf-973a-4fb9-92d1-22be605b1b43 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:58.024202 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-5fe44ddf-973a-4fb9-92d1-22be605b1b43 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:58.031305 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5fe44ddf-973a-4fb9-92d1-22be605b1b43 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:58.031757 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5fe44ddf-973a-4fb9-92d1-22be605b1b43 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:58.032518 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5fe44ddf-973a-4fb9-92d1-22be605b1b43 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:58.032957 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5fe44ddf-973a-4fb9-92d1-22be605b1b43 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:58.172427 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-5fe44ddf-973a-4fb9-92d1-22be605b1b43 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:58.181150 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-5fe44ddf-973a-4fb9-92d1-22be605b1b43 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:58.182959 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-5fe44ddf-973a-4fb9-92d1-22be605b1b43 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:58.184070 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-5fe44ddf-973a-4fb9-92d1-22be605b1b43 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1751 microversion: 2.20 time: 0.164979 Jun 22 10:25:58.184785 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 275/528] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:25:58 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1751 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:25:58.625562 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-6e8e5f7a-128f-47a6-9012-ff126a5e3f46 req-dcf5d60a-eadb-4d34-b2a2-cf8b77dd9690 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "755c0b10-e04a-42fa-86da-8cc65537315d", "name": "network-vif-unplugged", "status": "completed", "tag": "2931da67-7e8b-43c4-9fbb-3adba1b7225a"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:25:58.637849 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-6e8e5f7a-128f-47a6-9012-ff126a5e3f46 req-dcf5d60a-eadb-4d34-b2a2-cf8b77dd9690 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:58.638640 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-6e8e5f7a-128f-47a6-9012-ff126a5e3f46 req-dcf5d60a-eadb-4d34-b2a2-cf8b77dd9690 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:58.651690 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.compute.server_external_events [req-6e8e5f7a-128f-47a6-9012-ff126a5e3f46 req-dcf5d60a-eadb-4d34-b2a2-cf8b77dd9690 service nova] Unable to find a host for instance 755c0b10-e04a-42fa-86da-8cc65537315d. Dropping event network-vif-unplugged {{(pid=117679) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 22 10:25:58.652604 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-6e8e5f7a-128f-47a6-9012-ff126a5e3f46 req-dcf5d60a-eadb-4d34-b2a2-cf8b77dd9690 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031547 Jun 22 10:25:58.653203 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 254/529] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:25:58 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 22 10:25:59.203026 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-2e3c4467-60f3-4a8a-a123-ef3677a5a5fb tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:25:59.203634 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-2e3c4467-60f3-4a8a-a123-ef3677a5a5fb tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:25:59.210949 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2e3c4467-60f3-4a8a-a123-ef3677a5a5fb tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:59.211378 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2e3c4467-60f3-4a8a-a123-ef3677a5a5fb tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:59.212352 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2e3c4467-60f3-4a8a-a123-ef3677a5a5fb tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:25:59.212787 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2e3c4467-60f3-4a8a-a123-ef3677a5a5fb tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:25:59.344925 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-2e3c4467-60f3-4a8a-a123-ef3677a5a5fb tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:59.353513 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-2e3c4467-60f3-4a8a-a123-ef3677a5a5fb tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:59.355043 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-2e3c4467-60f3-4a8a-a123-ef3677a5a5fb tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:25:59.356201 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-2e3c4467-60f3-4a8a-a123-ef3677a5a5fb tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1753 microversion: 2.20 time: 0.157389 Jun 22 10:25:59.356762 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 276/530] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:25:59 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:26:00.379180 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-ccb84ace-ea3a-4b3d-9058-37fea2aba859 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:00.379759 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-ccb84ace-ea3a-4b3d-9058-37fea2aba859 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:00.386841 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ccb84ace-ea3a-4b3d-9058-37fea2aba859 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:00.387284 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ccb84ace-ea3a-4b3d-9058-37fea2aba859 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:00.388051 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ccb84ace-ea3a-4b3d-9058-37fea2aba859 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:00.388484 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ccb84ace-ea3a-4b3d-9058-37fea2aba859 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:00.588609 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-ccb84ace-ea3a-4b3d-9058-37fea2aba859 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:00.597437 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-ccb84ace-ea3a-4b3d-9058-37fea2aba859 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:00.598972 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-ccb84ace-ea3a-4b3d-9058-37fea2aba859 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:00.600158 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-ccb84ace-ea3a-4b3d-9058-37fea2aba859 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1809 microversion: 2.20 time: 0.224964 Jun 22 10:26:00.600680 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 255/531] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:26:00 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1809 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:26:01.618852 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-e7641a22-eab7-4d02-b514-fac92338198e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:01.620173 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-e7641a22-eab7-4d02-b514-fac92338198e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:01.628133 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e7641a22-eab7-4d02-b514-fac92338198e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:01.628906 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e7641a22-eab7-4d02-b514-fac92338198e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:01.629747 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e7641a22-eab7-4d02-b514-fac92338198e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:01.630234 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e7641a22-eab7-4d02-b514-fac92338198e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:01.784834 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-e7641a22-eab7-4d02-b514-fac92338198e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:01.797690 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-e7641a22-eab7-4d02-b514-fac92338198e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:01.799499 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-e7641a22-eab7-4d02-b514-fac92338198e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:01.800853 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-e7641a22-eab7-4d02-b514-fac92338198e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1809 microversion: 2.20 time: 0.185999 Jun 22 10:26:01.801463 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 277/532] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:26:01 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1809 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:26:02.820459 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-26c7314d-80e0-4c2d-8724-cee5b5e8efaa tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:02.821257 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-26c7314d-80e0-4c2d-8724-cee5b5e8efaa tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:02.830368 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-26c7314d-80e0-4c2d-8724-cee5b5e8efaa tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:02.830932 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-26c7314d-80e0-4c2d-8724-cee5b5e8efaa tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:02.831721 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-26c7314d-80e0-4c2d-8724-cee5b5e8efaa tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:02.832160 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-26c7314d-80e0-4c2d-8724-cee5b5e8efaa tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:02.978744 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-26c7314d-80e0-4c2d-8724-cee5b5e8efaa tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:02.993065 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-26c7314d-80e0-4c2d-8724-cee5b5e8efaa tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:02.994922 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-26c7314d-80e0-4c2d-8724-cee5b5e8efaa tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:02.996223 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-26c7314d-80e0-4c2d-8724-cee5b5e8efaa tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1809 microversion: 2.20 time: 0.179834 Jun 22 10:26:02.996972 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 256/533] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:26:02 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:26:04.014998 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-9855efc7-4eff-4ec4-881e-a3e506645370 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:04.015613 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-9855efc7-4eff-4ec4-881e-a3e506645370 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:04.022928 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9855efc7-4eff-4ec4-881e-a3e506645370 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:04.023356 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9855efc7-4eff-4ec4-881e-a3e506645370 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:04.024159 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9855efc7-4eff-4ec4-881e-a3e506645370 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:04.024620 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9855efc7-4eff-4ec4-881e-a3e506645370 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:04.163340 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-9855efc7-4eff-4ec4-881e-a3e506645370 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:04.172726 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-9855efc7-4eff-4ec4-881e-a3e506645370 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:04.174517 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-9855efc7-4eff-4ec4-881e-a3e506645370 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:04.175788 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-9855efc7-4eff-4ec4-881e-a3e506645370 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1809 microversion: 2.20 time: 0.165042 Jun 22 10:26:04.176411 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 278/534] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:26:04 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:26:05.197778 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-33ef46aa-0ada-4532-af3c-7e77e07d0d09 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:05.198789 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-33ef46aa-0ada-4532-af3c-7e77e07d0d09 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:05.207850 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-33ef46aa-0ada-4532-af3c-7e77e07d0d09 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:05.218852 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-33ef46aa-0ada-4532-af3c-7e77e07d0d09 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:05.219725 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-33ef46aa-0ada-4532-af3c-7e77e07d0d09 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:05.220176 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-33ef46aa-0ada-4532-af3c-7e77e07d0d09 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:05.357866 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-33ef46aa-0ada-4532-af3c-7e77e07d0d09 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:05.366992 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-33ef46aa-0ada-4532-af3c-7e77e07d0d09 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:05.368484 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-33ef46aa-0ada-4532-af3c-7e77e07d0d09 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:05.369602 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-33ef46aa-0ada-4532-af3c-7e77e07d0d09 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1809 microversion: 2.20 time: 0.178956 Jun 22 10:26:05.370203 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 257/535] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:26:05 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:26:06.391843 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-66fc27b9-1a88-41f1-b262-98e3ae86de7e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:06.392510 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-66fc27b9-1a88-41f1-b262-98e3ae86de7e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:06.399356 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-66fc27b9-1a88-41f1-b262-98e3ae86de7e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:06.400196 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-66fc27b9-1a88-41f1-b262-98e3ae86de7e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:06.400984 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-66fc27b9-1a88-41f1-b262-98e3ae86de7e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:06.401388 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-66fc27b9-1a88-41f1-b262-98e3ae86de7e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:06.540515 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-66fc27b9-1a88-41f1-b262-98e3ae86de7e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:06.564648 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-66fc27b9-1a88-41f1-b262-98e3ae86de7e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:06.567224 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-66fc27b9-1a88-41f1-b262-98e3ae86de7e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:06.569667 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-66fc27b9-1a88-41f1-b262-98e3ae86de7e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1809 microversion: 2.20 time: 0.184424 Jun 22 10:26:06.570310 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 279/536] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:26:06 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1809 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:26:07.605435 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-0cd2bce7-720f-4034-aa08-2bb66a501509 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:07.606095 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-0cd2bce7-720f-4034-aa08-2bb66a501509 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:07.612838 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0cd2bce7-720f-4034-aa08-2bb66a501509 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:07.613257 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0cd2bce7-720f-4034-aa08-2bb66a501509 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:07.614044 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0cd2bce7-720f-4034-aa08-2bb66a501509 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:07.614473 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0cd2bce7-720f-4034-aa08-2bb66a501509 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:07.752992 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-0cd2bce7-720f-4034-aa08-2bb66a501509 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:07.765533 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-0cd2bce7-720f-4034-aa08-2bb66a501509 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:07.767904 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-0cd2bce7-720f-4034-aa08-2bb66a501509 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:07.769660 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-0cd2bce7-720f-4034-aa08-2bb66a501509 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1809 microversion: 2.20 time: 0.168044 Jun 22 10:26:07.770640 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 258/537] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:26:07 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:26:08.789524 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-9b017171-17b9-4f17-bd41-bd4e5bb9bd79 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:08.790159 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-9b017171-17b9-4f17-bd41-bd4e5bb9bd79 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:08.796863 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9b017171-17b9-4f17-bd41-bd4e5bb9bd79 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:08.797300 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9b017171-17b9-4f17-bd41-bd4e5bb9bd79 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:08.798050 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9b017171-17b9-4f17-bd41-bd4e5bb9bd79 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:08.798477 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9b017171-17b9-4f17-bd41-bd4e5bb9bd79 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:08.930551 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-9b017171-17b9-4f17-bd41-bd4e5bb9bd79 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:08.939838 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-9b017171-17b9-4f17-bd41-bd4e5bb9bd79 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:08.941384 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-9b017171-17b9-4f17-bd41-bd4e5bb9bd79 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:08.942583 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-9b017171-17b9-4f17-bd41-bd4e5bb9bd79 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1809 microversion: 2.20 time: 0.157062 Jun 22 10:26:08.943141 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 280/538] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:26:08 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:26:09.963185 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-2f81031d-b502-4226-bbbd-720672237719 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:09.963807 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-2f81031d-b502-4226-bbbd-720672237719 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:09.970313 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2f81031d-b502-4226-bbbd-720672237719 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:09.970800 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2f81031d-b502-4226-bbbd-720672237719 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:09.971530 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2f81031d-b502-4226-bbbd-720672237719 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:09.971958 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2f81031d-b502-4226-bbbd-720672237719 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:10.111502 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-2f81031d-b502-4226-bbbd-720672237719 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:10.115129 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:26:10.121596 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-2f81031d-b502-4226-bbbd-720672237719 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:10.123122 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-2f81031d-b502-4226-bbbd-720672237719 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:10.124325 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-2f81031d-b502-4226-bbbd-720672237719 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1809 microversion: 2.20 time: 0.165490 Jun 22 10:26:10.124913 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 259/539] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:26:09 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:26:11.142990 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-4a59edf6-a623-46ad-ba68-b29a9df422cb tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:11.143676 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-4a59edf6-a623-46ad-ba68-b29a9df422cb tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:11.146077 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_api:SELECT=52 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:26:11.151625 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4a59edf6-a623-46ad-ba68-b29a9df422cb tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:11.152067 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4a59edf6-a623-46ad-ba68-b29a9df422cb tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:11.152836 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4a59edf6-a623-46ad-ba68-b29a9df422cb tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:11.153272 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4a59edf6-a623-46ad-ba68-b29a9df422cb tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:11.296182 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-4a59edf6-a623-46ad-ba68-b29a9df422cb tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:11.306492 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-4a59edf6-a623-46ad-ba68-b29a9df422cb tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:11.308649 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-4a59edf6-a623-46ad-ba68-b29a9df422cb tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:11.310061 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-4a59edf6-a623-46ad-ba68-b29a9df422cb tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1809 microversion: 2.20 time: 0.171173 Jun 22 10:26:11.311247 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 281/540] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:26:11 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:26:12.336691 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-073f69ef-16b0-48d8-b5bc-0da9b1a29ad2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:12.337531 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-073f69ef-16b0-48d8-b5bc-0da9b1a29ad2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:12.340205 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_api:SELECT=46 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:26:12.347020 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-073f69ef-16b0-48d8-b5bc-0da9b1a29ad2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:12.347476 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-073f69ef-16b0-48d8-b5bc-0da9b1a29ad2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:12.348269 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-073f69ef-16b0-48d8-b5bc-0da9b1a29ad2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:12.348693 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-073f69ef-16b0-48d8-b5bc-0da9b1a29ad2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:12.486213 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-073f69ef-16b0-48d8-b5bc-0da9b1a29ad2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:12.495337 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-073f69ef-16b0-48d8-b5bc-0da9b1a29ad2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:12.496836 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-073f69ef-16b0-48d8-b5bc-0da9b1a29ad2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:12.498017 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-073f69ef-16b0-48d8-b5bc-0da9b1a29ad2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1809 microversion: 2.20 time: 0.172358 Jun 22 10:26:12.498641 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 260/541] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:26:12 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:26:13.522964 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-7847f891-35da-46b5-ae3d-60cdba001bbc tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:13.523582 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-7847f891-35da-46b5-ae3d-60cdba001bbc tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:13.533315 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7847f891-35da-46b5-ae3d-60cdba001bbc tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:13.534116 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7847f891-35da-46b5-ae3d-60cdba001bbc tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:13.535210 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7847f891-35da-46b5-ae3d-60cdba001bbc tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:13.535757 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7847f891-35da-46b5-ae3d-60cdba001bbc tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:13.691036 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-7847f891-35da-46b5-ae3d-60cdba001bbc tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:13.694537 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:26:13.700627 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-7847f891-35da-46b5-ae3d-60cdba001bbc tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:13.702107 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-7847f891-35da-46b5-ae3d-60cdba001bbc tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:13.703284 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-7847f891-35da-46b5-ae3d-60cdba001bbc tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1809 microversion: 2.20 time: 0.186580 Jun 22 10:26:13.703857 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 282/542] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:26:13 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1809 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:26:14.722620 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-dc57f8a0-f945-4a21-b6f6-f7e8c8b47a97 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:14.723277 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-dc57f8a0-f945-4a21-b6f6-f7e8c8b47a97 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:14.730254 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-dc57f8a0-f945-4a21-b6f6-f7e8c8b47a97 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:14.730818 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-dc57f8a0-f945-4a21-b6f6-f7e8c8b47a97 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:14.731594 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-dc57f8a0-f945-4a21-b6f6-f7e8c8b47a97 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:14.732027 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-dc57f8a0-f945-4a21-b6f6-f7e8c8b47a97 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:14.875560 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-dc57f8a0-f945-4a21-b6f6-f7e8c8b47a97 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:14.884371 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-dc57f8a0-f945-4a21-b6f6-f7e8c8b47a97 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:14.885870 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-dc57f8a0-f945-4a21-b6f6-f7e8c8b47a97 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:14.887064 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-dc57f8a0-f945-4a21-b6f6-f7e8c8b47a97 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1809 microversion: 2.20 time: 0.168459 Jun 22 10:26:14.887622 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 261/543] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:26:14 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:26:15.907224 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-cd791813-d702-487c-b887-fedb0b733e7c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:15.907857 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-cd791813-d702-487c-b887-fedb0b733e7c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:15.916238 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-cd791813-d702-487c-b887-fedb0b733e7c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:15.916684 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-cd791813-d702-487c-b887-fedb0b733e7c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:15.917588 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-cd791813-d702-487c-b887-fedb0b733e7c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:15.918215 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-cd791813-d702-487c-b887-fedb0b733e7c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:16.056565 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-cd791813-d702-487c-b887-fedb0b733e7c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:16.065081 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-cd791813-d702-487c-b887-fedb0b733e7c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:16.066544 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-cd791813-d702-487c-b887-fedb0b733e7c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:16.067707 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-cd791813-d702-487c-b887-fedb0b733e7c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1809 microversion: 2.20 time: 0.165584 Jun 22 10:26:16.068542 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 283/544] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:26:15 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:26:17.090261 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-e105ef3c-ec80-4d07-8382-1bfe0aaec863 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:17.091360 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-e105ef3c-ec80-4d07-8382-1bfe0aaec863 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:17.101563 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e105ef3c-ec80-4d07-8382-1bfe0aaec863 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:17.104347 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e105ef3c-ec80-4d07-8382-1bfe0aaec863 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:17.105161 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e105ef3c-ec80-4d07-8382-1bfe0aaec863 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:17.105601 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e105ef3c-ec80-4d07-8382-1bfe0aaec863 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:17.260402 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-e105ef3c-ec80-4d07-8382-1bfe0aaec863 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:17.270727 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-e105ef3c-ec80-4d07-8382-1bfe0aaec863 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:17.272229 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-e105ef3c-ec80-4d07-8382-1bfe0aaec863 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:17.273396 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-e105ef3c-ec80-4d07-8382-1bfe0aaec863 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1809 microversion: 2.20 time: 0.189532 Jun 22 10:26:17.273989 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 262/545] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:26:17 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1809 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:26:18.292537 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-2a1f6423-4e4b-4520-9549-172876df4fe1 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:18.293174 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-2a1f6423-4e4b-4520-9549-172876df4fe1 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:18.299871 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2a1f6423-4e4b-4520-9549-172876df4fe1 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:18.300326 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2a1f6423-4e4b-4520-9549-172876df4fe1 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:18.301097 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2a1f6423-4e4b-4520-9549-172876df4fe1 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:18.301529 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2a1f6423-4e4b-4520-9549-172876df4fe1 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:18.438206 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-2a1f6423-4e4b-4520-9549-172876df4fe1 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:18.447559 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-2a1f6423-4e4b-4520-9549-172876df4fe1 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:18.449069 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-2a1f6423-4e4b-4520-9549-172876df4fe1 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:18.450238 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-2a1f6423-4e4b-4520-9549-172876df4fe1 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1809 microversion: 2.20 time: 0.161685 Jun 22 10:26:18.450837 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 284/546] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:26:18 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:26:19.473013 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-a4eb961e-c9d2-48e4-989b-908ba74eee52 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:19.473623 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-a4eb961e-c9d2-48e4-989b-908ba74eee52 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:19.480618 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a4eb961e-c9d2-48e4-989b-908ba74eee52 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:19.481247 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a4eb961e-c9d2-48e4-989b-908ba74eee52 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:19.482116 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a4eb961e-c9d2-48e4-989b-908ba74eee52 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:19.482545 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a4eb961e-c9d2-48e4-989b-908ba74eee52 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:19.640125 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-a4eb961e-c9d2-48e4-989b-908ba74eee52 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:19.649124 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-a4eb961e-c9d2-48e4-989b-908ba74eee52 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:19.650663 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-a4eb961e-c9d2-48e4-989b-908ba74eee52 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:19.651837 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-a4eb961e-c9d2-48e4-989b-908ba74eee52 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1809 microversion: 2.20 time: 0.182887 Jun 22 10:26:19.652391 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 263/547] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:26:19 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1809 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:26:20.671457 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-3ba77863-2087-426c-b941-01f27f877a6b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:20.672074 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-3ba77863-2087-426c-b941-01f27f877a6b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:20.679113 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3ba77863-2087-426c-b941-01f27f877a6b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:20.679568 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3ba77863-2087-426c-b941-01f27f877a6b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:20.680342 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3ba77863-2087-426c-b941-01f27f877a6b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:20.680780 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3ba77863-2087-426c-b941-01f27f877a6b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:20.816937 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-3ba77863-2087-426c-b941-01f27f877a6b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:20.825785 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-3ba77863-2087-426c-b941-01f27f877a6b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:20.827372 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-3ba77863-2087-426c-b941-01f27f877a6b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:20.828623 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-3ba77863-2087-426c-b941-01f27f877a6b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1809 microversion: 2.20 time: 0.161039 Jun 22 10:26:20.829202 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 285/548] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:26:20 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:26:21.848870 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-752c9fe3-803c-46e0-b53a-51b2ea768f7a tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:21.849467 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-752c9fe3-803c-46e0-b53a-51b2ea768f7a tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:21.856636 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-752c9fe3-803c-46e0-b53a-51b2ea768f7a tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:21.857090 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-752c9fe3-803c-46e0-b53a-51b2ea768f7a tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:21.857864 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-752c9fe3-803c-46e0-b53a-51b2ea768f7a tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:21.858302 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-752c9fe3-803c-46e0-b53a-51b2ea768f7a tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:22.000309 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-752c9fe3-803c-46e0-b53a-51b2ea768f7a tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:22.008869 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-752c9fe3-803c-46e0-b53a-51b2ea768f7a tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:22.010371 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-752c9fe3-803c-46e0-b53a-51b2ea768f7a tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:22.011550 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-752c9fe3-803c-46e0-b53a-51b2ea768f7a tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1809 microversion: 2.20 time: 0.167581 Jun 22 10:26:22.012099 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 264/549] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:26:21 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:26:23.031034 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-dd2ca7b5-9c6c-4980-9b45-0fbde108642a tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:23.031682 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-dd2ca7b5-9c6c-4980-9b45-0fbde108642a tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:23.040201 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-dd2ca7b5-9c6c-4980-9b45-0fbde108642a tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:23.040739 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-dd2ca7b5-9c6c-4980-9b45-0fbde108642a tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:23.041679 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-dd2ca7b5-9c6c-4980-9b45-0fbde108642a tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:23.042206 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-dd2ca7b5-9c6c-4980-9b45-0fbde108642a tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:23.174082 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-dd2ca7b5-9c6c-4980-9b45-0fbde108642a tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:23.182970 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-dd2ca7b5-9c6c-4980-9b45-0fbde108642a tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:23.184504 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-dd2ca7b5-9c6c-4980-9b45-0fbde108642a tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:23.185672 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-dd2ca7b5-9c6c-4980-9b45-0fbde108642a tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1809 microversion: 2.20 time: 0.159751 Jun 22 10:26:23.186218 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 286/550] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:26:23 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:26:24.208386 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-def8a6cb-9fc9-4b9d-bbfb-e912585c0c0c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:24.209335 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-def8a6cb-9fc9-4b9d-bbfb-e912585c0c0c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:24.220780 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-def8a6cb-9fc9-4b9d-bbfb-e912585c0c0c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:24.221477 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-def8a6cb-9fc9-4b9d-bbfb-e912585c0c0c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:24.222244 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-def8a6cb-9fc9-4b9d-bbfb-e912585c0c0c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:24.222700 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-def8a6cb-9fc9-4b9d-bbfb-e912585c0c0c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:24.361822 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-def8a6cb-9fc9-4b9d-bbfb-e912585c0c0c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:24.374339 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-def8a6cb-9fc9-4b9d-bbfb-e912585c0c0c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:24.376105 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-def8a6cb-9fc9-4b9d-bbfb-e912585c0c0c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:24.377789 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-def8a6cb-9fc9-4b9d-bbfb-e912585c0c0c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1809 microversion: 2.20 time: 0.176058 Jun 22 10:26:24.378371 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 265/551] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:26:24 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:26:25.396666 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-44570a01-635f-4703-ab42-447d59af7731 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:25.397344 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-44570a01-635f-4703-ab42-447d59af7731 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:25.404779 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-44570a01-635f-4703-ab42-447d59af7731 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:25.405231 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-44570a01-635f-4703-ab42-447d59af7731 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:25.406002 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-44570a01-635f-4703-ab42-447d59af7731 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:25.406441 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-44570a01-635f-4703-ab42-447d59af7731 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:25.545438 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-44570a01-635f-4703-ab42-447d59af7731 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:25.556166 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-44570a01-635f-4703-ab42-447d59af7731 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:25.557678 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-44570a01-635f-4703-ab42-447d59af7731 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:25.558902 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-44570a01-635f-4703-ab42-447d59af7731 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1809 microversion: 2.20 time: 0.166267 Jun 22 10:26:25.559427 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 287/552] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:26:25 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:26:26.578176 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-372642b5-4753-453a-b403-2e15465aa2b8 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:26.578823 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-372642b5-4753-453a-b403-2e15465aa2b8 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:26.586290 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-372642b5-4753-453a-b403-2e15465aa2b8 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:26.586742 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-372642b5-4753-453a-b403-2e15465aa2b8 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:26.587577 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-372642b5-4753-453a-b403-2e15465aa2b8 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:26.588041 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-372642b5-4753-453a-b403-2e15465aa2b8 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:26.719709 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-372642b5-4753-453a-b403-2e15465aa2b8 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:26.728575 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-372642b5-4753-453a-b403-2e15465aa2b8 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:26.730079 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-372642b5-4753-453a-b403-2e15465aa2b8 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:26.731285 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-372642b5-4753-453a-b403-2e15465aa2b8 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1809 microversion: 2.20 time: 0.157631 Jun 22 10:26:26.731884 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 266/553] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:26:26 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:26:27.751571 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-e56364eb-1e37-4fa2-b704-408b19a0ed94 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:27.752257 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-e56364eb-1e37-4fa2-b704-408b19a0ed94 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:27.761843 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e56364eb-1e37-4fa2-b704-408b19a0ed94 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:27.762280 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e56364eb-1e37-4fa2-b704-408b19a0ed94 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:27.763433 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e56364eb-1e37-4fa2-b704-408b19a0ed94 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:27.763992 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e56364eb-1e37-4fa2-b704-408b19a0ed94 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:27.911550 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-e56364eb-1e37-4fa2-b704-408b19a0ed94 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:27.920363 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-e56364eb-1e37-4fa2-b704-408b19a0ed94 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:27.921874 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-e56364eb-1e37-4fa2-b704-408b19a0ed94 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:27.923059 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-e56364eb-1e37-4fa2-b704-408b19a0ed94 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1809 microversion: 2.20 time: 0.176938 Jun 22 10:26:27.923691 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 288/554] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:26:27 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:26:28.908481 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-a6b08a3e-1705-483d-9c05-aba71b3f36f0 req-ae9c18bd-d96a-438a-b5a6-cf8aa1fc32cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "755c0b10-e04a-42fa-86da-8cc65537315d", "name": "network-vif-plugged", "status": "completed", "tag": "2931da67-7e8b-43c4-9fbb-3adba1b7225a"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:26:28.919625 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-a6b08a3e-1705-483d-9c05-aba71b3f36f0 req-ae9c18bd-d96a-438a-b5a6-cf8aa1fc32cf service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:28.920063 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-a6b08a3e-1705-483d-9c05-aba71b3f36f0 req-ae9c18bd-d96a-438a-b5a6-cf8aa1fc32cf service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:28.934211 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-a6b08a3e-1705-483d-9c05-aba71b3f36f0 req-ae9c18bd-d96a-438a-b5a6-cf8aa1fc32cf service nova] Creating event network-vif-plugged:2931da67-7e8b-43c4-9fbb-3adba1b7225a for instance 755c0b10-e04a-42fa-86da-8cc65537315d on hv-cinder-84713 Jun 22 10:26:28.939786 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-a6b08a3e-1705-483d-9c05-aba71b3f36f0 req-ae9c18bd-d96a-438a-b5a6-cf8aa1fc32cf service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118278 Jun 22 10:26:28.940582 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 267/555] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:26:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:26:28.942484 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-4648d66d-ef60-4154-80b3-af38e3a8b652 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:28.943242 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-4648d66d-ef60-4154-80b3-af38e3a8b652 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:28.950692 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4648d66d-ef60-4154-80b3-af38e3a8b652 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:28.951296 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4648d66d-ef60-4154-80b3-af38e3a8b652 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:28.952073 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4648d66d-ef60-4154-80b3-af38e3a8b652 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:28.952505 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4648d66d-ef60-4154-80b3-af38e3a8b652 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:29.087467 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-4648d66d-ef60-4154-80b3-af38e3a8b652 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:29.096254 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-4648d66d-ef60-4154-80b3-af38e3a8b652 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:29.097792 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-4648d66d-ef60-4154-80b3-af38e3a8b652 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:29.098981 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-4648d66d-ef60-4154-80b3-af38e3a8b652 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1809 microversion: 2.20 time: 0.161415 Jun 22 10:26:29.099543 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 289/556] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:26:28 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:26:30.118564 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-0ef3c763-5d50-447d-91f9-4f35a56a972b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:30.119284 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-0ef3c763-5d50-447d-91f9-4f35a56a972b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:30.125888 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0ef3c763-5d50-447d-91f9-4f35a56a972b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:30.126335 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0ef3c763-5d50-447d-91f9-4f35a56a972b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:30.127134 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0ef3c763-5d50-447d-91f9-4f35a56a972b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:30.127571 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0ef3c763-5d50-447d-91f9-4f35a56a972b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:30.261684 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-0ef3c763-5d50-447d-91f9-4f35a56a972b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:30.270567 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-0ef3c763-5d50-447d-91f9-4f35a56a972b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:30.272049 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-0ef3c763-5d50-447d-91f9-4f35a56a972b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:30.273211 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-0ef3c763-5d50-447d-91f9-4f35a56a972b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1809 microversion: 2.20 time: 0.159487 Jun 22 10:26:30.273786 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 268/557] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:26:30 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:26:31.293746 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-7bfdc8b0-905f-4a41-9c63-1058a22be823 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:31.294339 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-7bfdc8b0-905f-4a41-9c63-1058a22be823 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:31.301945 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7bfdc8b0-905f-4a41-9c63-1058a22be823 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:31.302395 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7bfdc8b0-905f-4a41-9c63-1058a22be823 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:31.303195 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7bfdc8b0-905f-4a41-9c63-1058a22be823 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:31.303639 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7bfdc8b0-905f-4a41-9c63-1058a22be823 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:31.447191 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-7bfdc8b0-905f-4a41-9c63-1058a22be823 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:31.456238 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-7bfdc8b0-905f-4a41-9c63-1058a22be823 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:31.459295 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-7bfdc8b0-905f-4a41-9c63-1058a22be823 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:31.460396 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-7bfdc8b0-905f-4a41-9c63-1058a22be823 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1809 microversion: 2.20 time: 0.171277 Jun 22 10:26:31.460959 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 290/558] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:26:31 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:26:32.479740 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-5b6f06de-efe0-4665-af01-41d13579250d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:32.480295 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-5b6f06de-efe0-4665-af01-41d13579250d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:32.487108 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5b6f06de-efe0-4665-af01-41d13579250d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:32.487594 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5b6f06de-efe0-4665-af01-41d13579250d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:32.488410 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5b6f06de-efe0-4665-af01-41d13579250d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:32.488869 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5b6f06de-efe0-4665-af01-41d13579250d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:32.621911 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-5b6f06de-efe0-4665-af01-41d13579250d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:32.640415 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-5b6f06de-efe0-4665-af01-41d13579250d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:32.642718 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-5b6f06de-efe0-4665-af01-41d13579250d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:32.644564 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-5b6f06de-efe0-4665-af01-41d13579250d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1796 microversion: 2.20 time: 0.168791 Jun 22 10:26:32.645307 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 269/559] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:26:32 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1796 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:26:36.039830 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-a5c213fb-be1b-4534-bd23-314401753494 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5fd6dc7d-56d3-454f-b891-90fcf015c968"}} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:26:36.040970 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-a5c213fb-be1b-4534-bd23-314401753494 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 156c832e-e672-428f-9404-1e2964ae5609] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:36.047453 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a5c213fb-be1b-4534-bd23-314401753494 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:36.047914 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a5c213fb-be1b-4534-bd23-314401753494 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:36.048680 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a5c213fb-be1b-4534-bd23-314401753494 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:36.049112 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a5c213fb-be1b-4534-bd23-314401753494 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:36.316668 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-a5c213fb-be1b-4534-bd23-314401753494 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "POST /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.396948 Jun 22 10:26:36.317301 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 291/560] 10.222.0.66 () {60 vars in 1322 bytes} [Wed Jun 22 10:26:35 2022] POST /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609/os-volume_attachments => generated 194 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:26:43.857969 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_api:SELECT=19 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:26:43.858624 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_cell1:SELECT=56 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:26:43.862819 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-e0550c2c-3cdf-4564-af96-528a82cf6533 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:26:43.863794 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-e0550c2c-3cdf-4564-af96-528a82cf6533 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 156c832e-e672-428f-9404-1e2964ae5609] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:43.870994 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e0550c2c-3cdf-4564-af96-528a82cf6533 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:43.871444 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e0550c2c-3cdf-4564-af96-528a82cf6533 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:43.872217 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e0550c2c-3cdf-4564-af96-528a82cf6533 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:43.872652 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e0550c2c-3cdf-4564-af96-528a82cf6533 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:43.897458 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.objects.instance [None req-e0550c2c-3cdf-4564-af96-528a82cf6533 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lazy-loading 'flavor' on Instance uuid 156c832e-e672-428f-9404-1e2964ae5609 {{(pid=117679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:26:44.047546 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-e0550c2c-3cdf-4564-af96-528a82cf6533 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "POST /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609/action" status: 200 len: 32 microversion: 2.1 time: 0.190401 Jun 22 10:26:44.048154 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 270/561] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Jun 22 10:26:43 2022] POST /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609/action => generated 32 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 22 10:26:44.058793 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-63ccac73-0244-475a-a951-57b1008b527b tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:44.059490 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-63ccac73-0244-475a-a951-57b1008b527b tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 156c832e-e672-428f-9404-1e2964ae5609] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:44.061456 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_api:SELECT=22 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:26:44.067313 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-63ccac73-0244-475a-a951-57b1008b527b tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:44.067767 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-63ccac73-0244-475a-a951-57b1008b527b tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:44.068596 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-63ccac73-0244-475a-a951-57b1008b527b tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:44.069032 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-63ccac73-0244-475a-a951-57b1008b527b tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:44.287391 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-63ccac73-0244-475a-a951-57b1008b527b tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:44.295752 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-63ccac73-0244-475a-a951-57b1008b527b tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609" status: 200 len: 1733 microversion: 2.1 time: 0.241795 Jun 22 10:26:44.296339 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 292/562] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:44 2022] GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609 => generated 1733 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:26:45.316195 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-025dfaf9-d0e2-4fa7-a858-d5a5b6b9e7e2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:45.316848 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-025dfaf9-d0e2-4fa7-a858-d5a5b6b9e7e2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 156c832e-e672-428f-9404-1e2964ae5609] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:45.325341 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-025dfaf9-d0e2-4fa7-a858-d5a5b6b9e7e2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:45.325860 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-025dfaf9-d0e2-4fa7-a858-d5a5b6b9e7e2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:45.326799 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-025dfaf9-d0e2-4fa7-a858-d5a5b6b9e7e2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:45.327297 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-025dfaf9-d0e2-4fa7-a858-d5a5b6b9e7e2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:45.473832 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-025dfaf9-d0e2-4fa7-a858-d5a5b6b9e7e2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:45.482426 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-025dfaf9-d0e2-4fa7-a858-d5a5b6b9e7e2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609" status: 200 len: 1733 microversion: 2.1 time: 0.171355 Jun 22 10:26:45.483073 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 271/563] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:45 2022] GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609 => generated 1733 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:46.500040 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-b9c721fc-0e62-4d08-9194-dcfff6151f8f tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:46.500683 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-b9c721fc-0e62-4d08-9194-dcfff6151f8f tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 156c832e-e672-428f-9404-1e2964ae5609] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:46.507907 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b9c721fc-0e62-4d08-9194-dcfff6151f8f tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:46.508365 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b9c721fc-0e62-4d08-9194-dcfff6151f8f tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:46.509166 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b9c721fc-0e62-4d08-9194-dcfff6151f8f tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:46.509606 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b9c721fc-0e62-4d08-9194-dcfff6151f8f tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:46.512197 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:26:46.648563 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-b9c721fc-0e62-4d08-9194-dcfff6151f8f tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:46.657065 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-b9c721fc-0e62-4d08-9194-dcfff6151f8f tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609" status: 200 len: 1733 microversion: 2.1 time: 0.160988 Jun 22 10:26:46.657631 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 293/564] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:46 2022] GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609 => generated 1733 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:47.676531 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-d15097e0-c8b4-4b6e-83ea-da180732fdf8 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:47.677116 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-d15097e0-c8b4-4b6e-83ea-da180732fdf8 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 156c832e-e672-428f-9404-1e2964ae5609] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:47.685565 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d15097e0-c8b4-4b6e-83ea-da180732fdf8 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:47.686055 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d15097e0-c8b4-4b6e-83ea-da180732fdf8 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:47.686954 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d15097e0-c8b4-4b6e-83ea-da180732fdf8 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:47.687621 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d15097e0-c8b4-4b6e-83ea-da180732fdf8 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:47.831148 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-d15097e0-c8b4-4b6e-83ea-da180732fdf8 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:47.839810 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-d15097e0-c8b4-4b6e-83ea-da180732fdf8 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609" status: 200 len: 1733 microversion: 2.1 time: 0.168603 Jun 22 10:26:47.840612 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 272/565] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:47 2022] GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609 => generated 1733 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:48.858138 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-9426cb54-c7ae-43f5-9266-b6975ab11f03 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:48.858789 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-9426cb54-c7ae-43f5-9266-b6975ab11f03 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 156c832e-e672-428f-9404-1e2964ae5609] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:48.867516 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9426cb54-c7ae-43f5-9266-b6975ab11f03 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:48.867993 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9426cb54-c7ae-43f5-9266-b6975ab11f03 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:48.868764 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9426cb54-c7ae-43f5-9266-b6975ab11f03 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:48.869200 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9426cb54-c7ae-43f5-9266-b6975ab11f03 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:49.016615 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-9426cb54-c7ae-43f5-9266-b6975ab11f03 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:49.026261 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-9426cb54-c7ae-43f5-9266-b6975ab11f03 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609" status: 200 len: 1733 microversion: 2.1 time: 0.172189 Jun 22 10:26:49.026878 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 294/566] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:48 2022] GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609 => generated 1733 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:50.049712 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-8b75de94-abae-4ece-8d29-23a0a837ef26 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:50.050615 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-8b75de94-abae-4ece-8d29-23a0a837ef26 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 156c832e-e672-428f-9404-1e2964ae5609] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:50.061975 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8b75de94-abae-4ece-8d29-23a0a837ef26 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:50.062563 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8b75de94-abae-4ece-8d29-23a0a837ef26 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:50.063924 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8b75de94-abae-4ece-8d29-23a0a837ef26 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:50.064660 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8b75de94-abae-4ece-8d29-23a0a837ef26 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:50.212054 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-8b75de94-abae-4ece-8d29-23a0a837ef26 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:50.220365 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-8b75de94-abae-4ece-8d29-23a0a837ef26 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609" status: 200 len: 1733 microversion: 2.1 time: 0.178145 Jun 22 10:26:50.220944 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 273/567] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:50 2022] GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609 => generated 1733 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:51.237908 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-3568149b-f392-4f2c-ab53-9028029c710d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:51.238615 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-3568149b-f392-4f2c-ab53-9028029c710d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 156c832e-e672-428f-9404-1e2964ae5609] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:51.245531 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3568149b-f392-4f2c-ab53-9028029c710d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:51.246009 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3568149b-f392-4f2c-ab53-9028029c710d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:51.246796 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3568149b-f392-4f2c-ab53-9028029c710d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:51.247224 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3568149b-f392-4f2c-ab53-9028029c710d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:51.389851 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-3568149b-f392-4f2c-ab53-9028029c710d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:51.402628 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-3568149b-f392-4f2c-ab53-9028029c710d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609" status: 200 len: 1733 microversion: 2.1 time: 0.168367 Jun 22 10:26:51.403450 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 295/568] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:51 2022] GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609 => generated 1733 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:52.426391 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-1acc5d93-c82d-4b27-8c87-7846f7366fc4 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:52.427071 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-1acc5d93-c82d-4b27-8c87-7846f7366fc4 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 156c832e-e672-428f-9404-1e2964ae5609] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:52.438060 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1acc5d93-c82d-4b27-8c87-7846f7366fc4 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:52.438731 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1acc5d93-c82d-4b27-8c87-7846f7366fc4 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:52.439867 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1acc5d93-c82d-4b27-8c87-7846f7366fc4 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:52.440480 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1acc5d93-c82d-4b27-8c87-7846f7366fc4 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:52.578190 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-1acc5d93-c82d-4b27-8c87-7846f7366fc4 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:52.586905 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-1acc5d93-c82d-4b27-8c87-7846f7366fc4 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609" status: 200 len: 1733 microversion: 2.1 time: 0.166523 Jun 22 10:26:52.587487 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 274/569] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:52 2022] GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609 => generated 1733 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:53.604672 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-f484ae73-cdd7-44e7-b073-134fd38cb689 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:53.605245 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-f484ae73-cdd7-44e7-b073-134fd38cb689 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 156c832e-e672-428f-9404-1e2964ae5609] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:53.612600 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f484ae73-cdd7-44e7-b073-134fd38cb689 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:53.613055 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f484ae73-cdd7-44e7-b073-134fd38cb689 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:53.613812 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f484ae73-cdd7-44e7-b073-134fd38cb689 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:53.614267 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f484ae73-cdd7-44e7-b073-134fd38cb689 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:53.757411 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-f484ae73-cdd7-44e7-b073-134fd38cb689 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:53.765670 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-f484ae73-cdd7-44e7-b073-134fd38cb689 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609" status: 200 len: 1733 microversion: 2.1 time: 0.165110 Jun 22 10:26:53.766239 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 296/570] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:53 2022] GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609 => generated 1733 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:54.785871 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-fa924c04-2c78-4c77-a424-49685e8cb31b tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:54.786717 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-fa924c04-2c78-4c77-a424-49685e8cb31b tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 156c832e-e672-428f-9404-1e2964ae5609] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:54.796287 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-fa924c04-2c78-4c77-a424-49685e8cb31b tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:54.796891 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-fa924c04-2c78-4c77-a424-49685e8cb31b tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:54.797913 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-fa924c04-2c78-4c77-a424-49685e8cb31b tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:54.798495 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-fa924c04-2c78-4c77-a424-49685e8cb31b tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:54.947943 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-fa924c04-2c78-4c77-a424-49685e8cb31b tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:54.956379 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-fa924c04-2c78-4c77-a424-49685e8cb31b tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609" status: 200 len: 1733 microversion: 2.1 time: 0.175727 Jun 22 10:26:54.956969 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 275/571] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:54 2022] GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609 => generated 1733 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:55.974045 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-b1bbe616-a3a1-4032-a722-aae09271b02d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:55.974766 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-b1bbe616-a3a1-4032-a722-aae09271b02d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 156c832e-e672-428f-9404-1e2964ae5609] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:55.981657 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b1bbe616-a3a1-4032-a722-aae09271b02d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:55.982116 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b1bbe616-a3a1-4032-a722-aae09271b02d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:55.982929 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b1bbe616-a3a1-4032-a722-aae09271b02d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:55.983368 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b1bbe616-a3a1-4032-a722-aae09271b02d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:56.126461 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-b1bbe616-a3a1-4032-a722-aae09271b02d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:56.135116 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-b1bbe616-a3a1-4032-a722-aae09271b02d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609" status: 200 len: 1733 microversion: 2.1 time: 0.165153 Jun 22 10:26:56.135671 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 297/572] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:55 2022] GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609 => generated 1733 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:57.155905 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-eae99c09-07bc-4037-bee8-0d301f51f206 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:57.156683 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-eae99c09-07bc-4037-bee8-0d301f51f206 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 156c832e-e672-428f-9404-1e2964ae5609] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:57.166206 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-eae99c09-07bc-4037-bee8-0d301f51f206 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:57.166927 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-eae99c09-07bc-4037-bee8-0d301f51f206 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:57.167980 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-eae99c09-07bc-4037-bee8-0d301f51f206 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:57.168595 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-eae99c09-07bc-4037-bee8-0d301f51f206 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:57.308965 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-eae99c09-07bc-4037-bee8-0d301f51f206 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:57.317701 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-eae99c09-07bc-4037-bee8-0d301f51f206 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609" status: 200 len: 1733 microversion: 2.1 time: 0.167608 Jun 22 10:26:57.318296 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 276/573] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:57 2022] GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609 => generated 1733 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:58.339803 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-09dc5d2f-d205-4155-99a3-9ca30c431106 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:58.340613 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-09dc5d2f-d205-4155-99a3-9ca30c431106 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 156c832e-e672-428f-9404-1e2964ae5609] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:58.350111 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-09dc5d2f-d205-4155-99a3-9ca30c431106 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:58.350627 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-09dc5d2f-d205-4155-99a3-9ca30c431106 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:58.351419 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-09dc5d2f-d205-4155-99a3-9ca30c431106 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:58.351857 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-09dc5d2f-d205-4155-99a3-9ca30c431106 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:58.506814 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-09dc5d2f-d205-4155-99a3-9ca30c431106 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:58.515350 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-09dc5d2f-d205-4155-99a3-9ca30c431106 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609" status: 200 len: 1733 microversion: 2.1 time: 0.181142 Jun 22 10:26:58.515921 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 298/574] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:58 2022] GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609 => generated 1733 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:59.533611 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-7373aea7-02f4-444b-ab6f-16b07570a372 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:59.534218 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-7373aea7-02f4-444b-ab6f-16b07570a372 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 156c832e-e672-428f-9404-1e2964ae5609] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:59.542913 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7373aea7-02f4-444b-ab6f-16b07570a372 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:59.543667 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7373aea7-02f4-444b-ab6f-16b07570a372 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:59.544909 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7373aea7-02f4-444b-ab6f-16b07570a372 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:59.545634 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7373aea7-02f4-444b-ab6f-16b07570a372 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:59.688887 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-7373aea7-02f4-444b-ab6f-16b07570a372 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:26:59.697428 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-7373aea7-02f4-444b-ab6f-16b07570a372 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609" status: 200 len: 1713 microversion: 2.1 time: 0.167741 Jun 22 10:26:59.697972 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 277/575] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:59 2022] GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609 => generated 1713 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:26:59.758718 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-d17f12e0-e552-4c20-906f-00d3ca7ae0b2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:26:59.759232 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-d17f12e0-e552-4c20-906f-00d3ca7ae0b2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 156c832e-e672-428f-9404-1e2964ae5609] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:59.766128 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d17f12e0-e552-4c20-906f-00d3ca7ae0b2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:59.766609 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d17f12e0-e552-4c20-906f-00d3ca7ae0b2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:59.767371 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d17f12e0-e552-4c20-906f-00d3ca7ae0b2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:59.767806 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d17f12e0-e552-4c20-906f-00d3ca7ae0b2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:59.900541 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.wsgi [None req-d17f12e0-e552-4c20-906f-00d3ca7ae0b2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] HTTP exception thrown: Cannot 'detach_volume' instance 156c832e-e672-428f-9404-1e2964ae5609 while it is in vm_state rescued Jun 22 10:26:59.902217 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-d17f12e0-e552-4c20-906f-00d3ca7ae0b2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Request method failure captured: Jun 22 10:26:59.902217 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: request: DELETE /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609/os-volume_attachments/5fd6dc7d-56d3-454f-b891-90fcf015c968 HTTP/1.1 Jun 22 10:26:59.902217 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Accept: application/json Jun 22 10:26:59.902217 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Accept-Encoding: identity Jun 22 10:26:59.902217 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Connection: close Jun 22 10:26:59.902217 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Content-Length: 0 Jun 22 10:26:59.902217 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Content-Type: application/json Jun 22 10:26:59.902217 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Host: 10.222.0.66 Jun 22 10:26:59.902217 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Openstack-System-Scope: None Jun 22 10:26:59.902217 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: User-Agent: python-urllib3/1.26.9 Jun 22 10:26:59.902217 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Auth-Token: gAAAAABisu0KTX4LByDrs2wd0wf7QkjgZCYL58jTaGKxU6GloV6S5vTA8f4YmIXgHT_KMAgKu1jdsn-8Uga7Qnln7YVuKutNjZ4Xn3tAFNoo7zG8SK5VuNoRcwHUn_V5P08hyf2Bosoz8F0t6BB7YpwwfdbxZ3fftIbWEfVknGZuJ2vKr7E2QFU Jun 22 10:26:59.902217 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Domain-Id: None Jun 22 10:26:59.902217 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Domain-Name: None Jun 22 10:26:59.902217 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Identity-Status: Confirmed Jun 22 10:26:59.902217 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Is-Admin-Project: True Jun 22 10:26:59.902217 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Domain-Id: default Jun 22 10:26:59.902217 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Domain-Name: Default Jun 22 10:26:59.902217 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Id: f20791fa785649cfa5df1f60df84dbdb Jun 22 10:26:59.902217 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2082763206 Jun 22 10:26:59.902217 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Role: member,reader Jun 22 10:26:59.902217 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Roles: member,reader Jun 22 10:26:59.903965 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f20791fa785649cfa5df1f60df84dbdb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f20791fa785649cfa5df1f60df84dbdb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f20791fa785649cfa5df1f60df84dbdb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f20791fa785649cfa5df1f60df84dbdb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}] Jun 22 10:26:59.903965 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2082763206 Jun 22 10:26:59.903965 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant-Id: f20791fa785649cfa5df1f60df84dbdb Jun 22 10:26:59.903965 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2082763206 Jun 22 10:26:59.903965 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User: tempest-ServerRescueNegativeTestJSON-2082763206-project Jun 22 10:26:59.903965 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Domain-Id: default Jun 22 10:26:59.903965 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Domain-Name: Default Jun 22 10:26:59.903965 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Id: 8fc916f852f4433eac4a3a2a12384834 Jun 22 10:26:59.903965 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2082763206-project Jun 22 10:26:59.903965 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: method: > Jun 22 10:26:59.903965 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: exception: Cannot 'detach_volume' instance 156c832e-e672-428f-9404-1e2964ae5609 while it is in vm_state rescued Jun 22 10:26:59.904659 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: action_args: {'server_id': '156c832e-e672-428f-9404-1e2964ae5609', 'id': '5fd6dc7d-56d3-454f-b891-90fcf015c968'} Jun 22 10:26:59.904659 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:26:59.904659 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:26:59.904659 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 22 10:26:59.904659 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 22 10:26:59.904659 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 22 10:26:59.904659 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 22 10:26:59.904659 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 22 10:26:59.904659 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 22 10:26:59.904659 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 156c832e-e672-428f-9404-1e2964ae5609 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 22 10:26:59.904659 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:26:59.904659 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:26:59.904659 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:26:59.904659 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:26:59.904659 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:26:59.904659 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:26:59.904659 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:26:59.904659 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:26:59.904659 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:26:59.904659 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:26:59.906014 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 22 10:26:59.906014 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 22 10:26:59.906014 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 22 10:26:59.906014 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 22 10:26:59.906014 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 156c832e-e672-428f-9404-1e2964ae5609 while it is in vm_state rescued Jun 22 10:26:59.906014 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:26:59.906014 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:26:59.906014 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:26:59.906014 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:26:59.906014 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:26:59.906014 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:26:59.906014 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:26:59.906014 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:26:59.906014 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 156c832e-e672-428f-9404-1e2964ae5609 while it is in vm_state rescued Jun 22 10:26:59.906014 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:26:59.906014 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-d17f12e0-e552-4c20-906f-00d3ca7ae0b2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Returning 409 to user: Cannot 'detach_volume' instance 156c832e-e672-428f-9404-1e2964ae5609 while it is in vm_state rescued {{(pid=117680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:26:59.907243 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-d17f12e0-e552-4c20-906f-00d3ca7ae0b2 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "DELETE /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609/os-volume_attachments/5fd6dc7d-56d3-454f-b891-90fcf015c968" status: 409 len: 152 microversion: 2.1 time: 0.149915 Jun 22 10:26:59.907243 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 299/576] 10.222.0.66 () {58 vars in 1415 bytes} [Wed Jun 22 10:26:59 2022] DELETE /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609/os-volume_attachments/5fd6dc7d-56d3-454f-b891-90fcf015c968 => generated 152 bytes in 152 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 22 10:26:59.913047 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-0019bbe8-6e8d-489a-9017-afc95148ab3b tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:26:59.913573 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-0019bbe8-6e8d-489a-9017-afc95148ab3b tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 156c832e-e672-428f-9404-1e2964ae5609] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:26:59.919913 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0019bbe8-6e8d-489a-9017-afc95148ab3b tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:59.920358 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0019bbe8-6e8d-489a-9017-afc95148ab3b tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:59.921107 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0019bbe8-6e8d-489a-9017-afc95148ab3b tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:26:59.921530 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0019bbe8-6e8d-489a-9017-afc95148ab3b tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:26:59.991576 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-0019bbe8-6e8d-489a-9017-afc95148ab3b tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "POST /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609/action" status: 202 len: 0 microversion: 2.1 time: 0.081813 Jun 22 10:26:59.992657 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 278/577] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Jun 22 10:26:59 2022] POST /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 22 10:27:00.003882 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-30165f02-7e6d-471c-bb63-1c91e310fee8 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:00.005128 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-30165f02-7e6d-471c-bb63-1c91e310fee8 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 156c832e-e672-428f-9404-1e2964ae5609] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:00.012543 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-30165f02-7e6d-471c-bb63-1c91e310fee8 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:00.013021 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-30165f02-7e6d-471c-bb63-1c91e310fee8 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:00.013818 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-30165f02-7e6d-471c-bb63-1c91e310fee8 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:00.014261 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-30165f02-7e6d-471c-bb63-1c91e310fee8 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:00.477873 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-30165f02-7e6d-471c-bb63-1c91e310fee8 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:00.487272 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-30165f02-7e6d-471c-bb63-1c91e310fee8 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609" status: 200 len: 1721 microversion: 2.1 time: 0.489112 Jun 22 10:27:00.487865 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 300/578] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:26:59 2022] GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609 => generated 1721 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:27:01.506898 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-6991d77d-908a-49b2-90d5-45c2c7e279e1 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:01.507598 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-6991d77d-908a-49b2-90d5-45c2c7e279e1 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 156c832e-e672-428f-9404-1e2964ae5609] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:01.514610 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6991d77d-908a-49b2-90d5-45c2c7e279e1 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:01.515022 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6991d77d-908a-49b2-90d5-45c2c7e279e1 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:01.515812 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6991d77d-908a-49b2-90d5-45c2c7e279e1 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:01.516271 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6991d77d-908a-49b2-90d5-45c2c7e279e1 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:01.655350 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-6991d77d-908a-49b2-90d5-45c2c7e279e1 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:01.667767 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-6991d77d-908a-49b2-90d5-45c2c7e279e1 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609" status: 200 len: 1721 microversion: 2.1 time: 0.165526 Jun 22 10:27:01.668612 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 279/579] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:27:01 2022] GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609 => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:27:02.690524 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-61144529-611a-41f1-805f-117055d13698 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:02.691150 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-61144529-611a-41f1-805f-117055d13698 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 156c832e-e672-428f-9404-1e2964ae5609] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:02.699002 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-61144529-611a-41f1-805f-117055d13698 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:02.699458 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-61144529-611a-41f1-805f-117055d13698 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:02.700237 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-61144529-611a-41f1-805f-117055d13698 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:02.700675 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-61144529-611a-41f1-805f-117055d13698 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:02.839502 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-61144529-611a-41f1-805f-117055d13698 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:02.848178 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-61144529-611a-41f1-805f-117055d13698 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609" status: 200 len: 1721 microversion: 2.1 time: 0.163418 Jun 22 10:27:02.848754 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 301/580] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:27:02 2022] GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:27:03.866531 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-26e61a55-475e-4836-b424-df3f119adf7d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:03.867247 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-26e61a55-475e-4836-b424-df3f119adf7d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 156c832e-e672-428f-9404-1e2964ae5609] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:03.873574 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-26e61a55-475e-4836-b424-df3f119adf7d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:03.874003 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-26e61a55-475e-4836-b424-df3f119adf7d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:03.874852 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-26e61a55-475e-4836-b424-df3f119adf7d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:03.875311 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-26e61a55-475e-4836-b424-df3f119adf7d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:04.027689 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-26e61a55-475e-4836-b424-df3f119adf7d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:04.039309 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-26e61a55-475e-4836-b424-df3f119adf7d tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609" status: 200 len: 1727 microversion: 2.1 time: 0.176856 Jun 22 10:27:04.039831 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 280/581] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:27:03 2022] GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609 => generated 1727 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:27:04.055956 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-aad7d8d0-5696-440d-b631-03365f5a1a6a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:04.056521 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-aad7d8d0-5696-440d-b631-03365f5a1a6a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 156c832e-e672-428f-9404-1e2964ae5609] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:04.063755 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-aad7d8d0-5696-440d-b631-03365f5a1a6a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:04.064206 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-aad7d8d0-5696-440d-b631-03365f5a1a6a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:04.064980 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-aad7d8d0-5696-440d-b631-03365f5a1a6a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:04.065418 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-aad7d8d0-5696-440d-b631-03365f5a1a6a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:04.151680 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-aad7d8d0-5696-440d-b631-03365f5a1a6a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099308 Jun 22 10:27:04.152528 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 302/582] 10.222.0.66 () {58 vars in 1274 bytes} [Wed Jun 22 10:27:04 2022] GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:27:05.343653 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-8284cf98-49c2-47a8-98a0-a4ef27bd9b68 req-1e5df01b-c6e1-4c86-95d4-b395ced6922d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "156c832e-e672-428f-9404-1e2964ae5609", "tag": "d5a527b2-317f-467a-b39d-b955e3a5dea6"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:27:05.355247 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-8284cf98-49c2-47a8-98a0-a4ef27bd9b68 req-1e5df01b-c6e1-4c86-95d4-b395ced6922d service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:05.355725 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-8284cf98-49c2-47a8-98a0-a4ef27bd9b68 req-1e5df01b-c6e1-4c86-95d4-b395ced6922d service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:05.369352 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-8284cf98-49c2-47a8-98a0-a4ef27bd9b68 req-1e5df01b-c6e1-4c86-95d4-b395ced6922d service nova] Creating event network-changed:d5a527b2-317f-467a-b39d-b955e3a5dea6 for instance 156c832e-e672-428f-9404-1e2964ae5609 on hv-cinder-84713 Jun 22 10:27:05.374839 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-8284cf98-49c2-47a8-98a0-a4ef27bd9b68 req-1e5df01b-c6e1-4c86-95d4-b395ced6922d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098457 Jun 22 10:27:05.375412 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 281/583] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:27:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:27:07.391491 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-51a1b54d-5783-4221-8eb2-8dff1e5bb748 req-5178244e-d2a5-4092-93b0-3fde720ddff8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "156c832e-e672-428f-9404-1e2964ae5609", "tag": "d5a527b2-317f-467a-b39d-b955e3a5dea6"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:27:07.400130 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-51a1b54d-5783-4221-8eb2-8dff1e5bb748 req-5178244e-d2a5-4092-93b0-3fde720ddff8 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:07.400572 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-51a1b54d-5783-4221-8eb2-8dff1e5bb748 req-5178244e-d2a5-4092-93b0-3fde720ddff8 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:07.412458 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-51a1b54d-5783-4221-8eb2-8dff1e5bb748 req-5178244e-d2a5-4092-93b0-3fde720ddff8 service nova] Creating event network-changed:d5a527b2-317f-467a-b39d-b955e3a5dea6 for instance 156c832e-e672-428f-9404-1e2964ae5609 on hv-cinder-84713 Jun 22 10:27:07.418129 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-51a1b54d-5783-4221-8eb2-8dff1e5bb748 req-5178244e-d2a5-4092-93b0-3fde720ddff8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030860 Jun 22 10:27:07.418816 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 303/584] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:27:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:27:07.550320 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-015a633c-daef-4b1c-b2ba-251837b86d0c tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:07.550948 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-015a633c-daef-4b1c-b2ba-251837b86d0c tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: da28df11-c078-43d5-81c4-e78ccf9f6504] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:07.557344 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-015a633c-daef-4b1c-b2ba-251837b86d0c tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:07.557793 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-015a633c-daef-4b1c-b2ba-251837b86d0c tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:07.558579 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-015a633c-daef-4b1c-b2ba-251837b86d0c tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:07.559021 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-015a633c-daef-4b1c-b2ba-251837b86d0c tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:07.685023 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.objects.instance [None req-015a633c-daef-4b1c-b2ba-251837b86d0c tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lazy-loading 'services' on Instance uuid da28df11-c078-43d5-81c4-e78ccf9f6504 {{(pid=117679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:27:07.800826 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-015a633c-daef-4b1c-b2ba-251837b86d0c tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "DELETE /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504/os-volume_attachments/0397d9c5-c8a2-4249-948f-ac59cc55909e" status: 202 len: 0 microversion: 2.1 time: 0.359653 Jun 22 10:27:07.801424 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 282/585] 10.222.0.66 () {58 vars in 1415 bytes} [Wed Jun 22 10:27:07 2022] DELETE /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504/os-volume_attachments/0397d9c5-c8a2-4249-948f-ac59cc55909e => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:27:08.920676 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-b13baf93-59f9-402a-8f5d-a9a137298585 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:27:08.927423 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b13baf93-59f9-402a-8f5d-a9a137298585 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:08.927910 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b13baf93-59f9-402a-8f5d-a9a137298585 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:08.987896 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-b13baf93-59f9-402a-8f5d-a9a137298585 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: da28df11-c078-43d5-81c4-e78ccf9f6504] Going to try to stop instance {{(pid=117680) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 22 10:27:09.038447 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-b13baf93-59f9-402a-8f5d-a9a137298585 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "POST /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504/action" status: 202 len: 0 microversion: 2.1 time: 0.121464 Jun 22 10:27:09.039166 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 304/586] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Jun 22 10:27:08 2022] POST /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:27:09.048920 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-3da4fc22-dcac-41d1-9cf0-dc87dcd664a4 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:09.049613 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-3da4fc22-dcac-41d1-9cf0-dc87dcd664a4 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: da28df11-c078-43d5-81c4-e78ccf9f6504] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:09.057153 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3da4fc22-dcac-41d1-9cf0-dc87dcd664a4 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:09.057951 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3da4fc22-dcac-41d1-9cf0-dc87dcd664a4 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:09.058759 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3da4fc22-dcac-41d1-9cf0-dc87dcd664a4 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:09.059307 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3da4fc22-dcac-41d1-9cf0-dc87dcd664a4 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:09.079628 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:27:09.208802 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-3da4fc22-dcac-41d1-9cf0-dc87dcd664a4 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:09.216915 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-3da4fc22-dcac-41d1-9cf0-dc87dcd664a4 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504" status: 200 len: 1678 microversion: 2.1 time: 0.173032 Jun 22 10:27:09.217494 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 283/587] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:27:09 2022] GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504 => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:27:10.235316 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-b46c5475-8fc2-4a8d-b0db-65b093ee01ae tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:10.236090 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-b46c5475-8fc2-4a8d-b0db-65b093ee01ae tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: da28df11-c078-43d5-81c4-e78ccf9f6504] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:10.243322 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b46c5475-8fc2-4a8d-b0db-65b093ee01ae tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:10.243773 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b46c5475-8fc2-4a8d-b0db-65b093ee01ae tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:10.244550 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b46c5475-8fc2-4a8d-b0db-65b093ee01ae tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:10.244992 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b46c5475-8fc2-4a8d-b0db-65b093ee01ae tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:10.378256 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-b46c5475-8fc2-4a8d-b0db-65b093ee01ae tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:10.386395 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-b46c5475-8fc2-4a8d-b0db-65b093ee01ae tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504" status: 200 len: 1678 microversion: 2.1 time: 0.155438 Jun 22 10:27:10.387011 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 305/588] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:27:10 2022] GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:27:11.404189 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-ad3492a1-5b3a-467a-9912-e316c99c9833 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:11.404805 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-ad3492a1-5b3a-467a-9912-e316c99c9833 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: da28df11-c078-43d5-81c4-e78ccf9f6504] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:11.411598 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ad3492a1-5b3a-467a-9912-e316c99c9833 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:11.412054 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ad3492a1-5b3a-467a-9912-e316c99c9833 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:11.412837 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ad3492a1-5b3a-467a-9912-e316c99c9833 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:11.413292 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ad3492a1-5b3a-467a-9912-e316c99c9833 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:11.558628 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-ad3492a1-5b3a-467a-9912-e316c99c9833 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:11.566532 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-ad3492a1-5b3a-467a-9912-e316c99c9833 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504" status: 200 len: 1678 microversion: 2.1 time: 0.166528 Jun 22 10:27:11.567099 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 284/589] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:27:11 2022] GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504 => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:27:12.584078 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-bd40b99c-3d5e-4145-8042-a15c20f3e60b tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:12.584688 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-bd40b99c-3d5e-4145-8042-a15c20f3e60b tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: da28df11-c078-43d5-81c4-e78ccf9f6504] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:12.591770 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-bd40b99c-3d5e-4145-8042-a15c20f3e60b tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:12.592219 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-bd40b99c-3d5e-4145-8042-a15c20f3e60b tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:12.592993 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-bd40b99c-3d5e-4145-8042-a15c20f3e60b tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:12.593427 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-bd40b99c-3d5e-4145-8042-a15c20f3e60b tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:12.729469 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-bd40b99c-3d5e-4145-8042-a15c20f3e60b tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:12.737510 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-bd40b99c-3d5e-4145-8042-a15c20f3e60b tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504" status: 200 len: 1678 microversion: 2.1 time: 0.157542 Jun 22 10:27:12.738093 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 306/590] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:27:12 2022] GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:27:13.755961 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-092c8f12-d521-41dd-9108-daab34c2f10d tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:13.756564 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-092c8f12-d521-41dd-9108-daab34c2f10d tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: da28df11-c078-43d5-81c4-e78ccf9f6504] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:13.764069 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-092c8f12-d521-41dd-9108-daab34c2f10d tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:13.764590 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-092c8f12-d521-41dd-9108-daab34c2f10d tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:13.765429 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-092c8f12-d521-41dd-9108-daab34c2f10d tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:13.765877 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-092c8f12-d521-41dd-9108-daab34c2f10d tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:13.913619 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-092c8f12-d521-41dd-9108-daab34c2f10d tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:13.921576 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-092c8f12-d521-41dd-9108-daab34c2f10d tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504" status: 200 len: 1678 microversion: 2.1 time: 0.170151 Jun 22 10:27:13.922151 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 285/591] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:27:13 2022] GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504 => generated 1678 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:27:14.939238 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-a5f4fd5e-1878-4676-8c45-236d346cf797 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:14.939790 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-a5f4fd5e-1878-4676-8c45-236d346cf797 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: da28df11-c078-43d5-81c4-e78ccf9f6504] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:14.942226 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_api:SELECT=30 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:27:14.948029 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a5f4fd5e-1878-4676-8c45-236d346cf797 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:14.948475 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a5f4fd5e-1878-4676-8c45-236d346cf797 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:14.949244 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a5f4fd5e-1878-4676-8c45-236d346cf797 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:14.949680 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a5f4fd5e-1878-4676-8c45-236d346cf797 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:15.095520 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-a5f4fd5e-1878-4676-8c45-236d346cf797 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:15.103486 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-a5f4fd5e-1878-4676-8c45-236d346cf797 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504" status: 200 len: 1678 microversion: 2.1 time: 0.168208 Jun 22 10:27:15.104067 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 307/592] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:27:14 2022] GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504 => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:27:16.121596 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-42a2a5f3-7a17-4e14-a709-c5ca0488d917 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:16.122285 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-42a2a5f3-7a17-4e14-a709-c5ca0488d917 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: da28df11-c078-43d5-81c4-e78ccf9f6504] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:16.124743 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_api:SELECT=33 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:27:16.130351 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-42a2a5f3-7a17-4e14-a709-c5ca0488d917 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:16.130950 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-42a2a5f3-7a17-4e14-a709-c5ca0488d917 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:16.131710 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-42a2a5f3-7a17-4e14-a709-c5ca0488d917 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:16.132136 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-42a2a5f3-7a17-4e14-a709-c5ca0488d917 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:16.278163 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-42a2a5f3-7a17-4e14-a709-c5ca0488d917 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:16.286911 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-42a2a5f3-7a17-4e14-a709-c5ca0488d917 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504" status: 200 len: 1678 microversion: 2.1 time: 0.169425 Jun 22 10:27:16.287655 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 286/593] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:27:16 2022] GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504 => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:27:17.305885 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-0b871500-44fa-4461-83c7-14fe122a9035 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:17.306477 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-0b871500-44fa-4461-83c7-14fe122a9035 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: da28df11-c078-43d5-81c4-e78ccf9f6504] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:17.313335 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0b871500-44fa-4461-83c7-14fe122a9035 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:17.313784 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0b871500-44fa-4461-83c7-14fe122a9035 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:17.314551 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0b871500-44fa-4461-83c7-14fe122a9035 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:17.315011 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0b871500-44fa-4461-83c7-14fe122a9035 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:17.317560 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:27:17.477586 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-0b871500-44fa-4461-83c7-14fe122a9035 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:17.486659 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-0b871500-44fa-4461-83c7-14fe122a9035 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504" status: 200 len: 1678 microversion: 2.1 time: 0.184798 Jun 22 10:27:17.487717 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 308/594] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:27:17 2022] GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504 => generated 1678 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:27:18.506554 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-b48f87eb-6729-4b6d-89e3-e86c2b2f70af tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:18.507241 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-b48f87eb-6729-4b6d-89e3-e86c2b2f70af tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: da28df11-c078-43d5-81c4-e78ccf9f6504] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:18.514301 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b48f87eb-6729-4b6d-89e3-e86c2b2f70af tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:18.514805 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b48f87eb-6729-4b6d-89e3-e86c2b2f70af tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:18.515577 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b48f87eb-6729-4b6d-89e3-e86c2b2f70af tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:18.516014 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b48f87eb-6729-4b6d-89e3-e86c2b2f70af tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:18.662697 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-b48f87eb-6729-4b6d-89e3-e86c2b2f70af tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:18.670602 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-b48f87eb-6729-4b6d-89e3-e86c2b2f70af tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504" status: 200 len: 1678 microversion: 2.1 time: 0.168027 Jun 22 10:27:18.671170 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 287/595] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:27:18 2022] GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504 => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:27:19.260689 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-cda30b6c-ffbc-4f99-ba81-ccd2b9b9612a tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:19.261235 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-cda30b6c-ffbc-4f99-ba81-ccd2b9b9612a tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 3cc6d1fb-02b4-411e-84a2-eb5a63344e0d] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:19.268234 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-cda30b6c-ffbc-4f99-ba81-ccd2b9b9612a tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:19.268683 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-cda30b6c-ffbc-4f99-ba81-ccd2b9b9612a tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:19.269449 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-cda30b6c-ffbc-4f99-ba81-ccd2b9b9612a tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:19.269882 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-cda30b6c-ffbc-4f99-ba81-ccd2b9b9612a tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:19.295748 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-cda30b6c-ffbc-4f99-ba81-ccd2b9b9612a tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 3cc6d1fb-02b4-411e-84a2-eb5a63344e0d] Going to try to terminate instance {{(pid=117680) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 10:27:19.380130 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-cda30b6c-ffbc-4f99-ba81-ccd2b9b9612a tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "DELETE /compute/v2.1/servers/3cc6d1fb-02b4-411e-84a2-eb5a63344e0d" status: 204 len: 0 microversion: 2.1 time: 0.123174 Jun 22 10:27:19.380966 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 309/596] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Jun 22 10:27:19 2022] DELETE /compute/v2.1/servers/3cc6d1fb-02b4-411e-84a2-eb5a63344e0d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 10:27:19.389254 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-c652a76a-239f-4c8d-85be-f2a1a57c8c03 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:19.389906 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-c652a76a-239f-4c8d-85be-f2a1a57c8c03 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 3cc6d1fb-02b4-411e-84a2-eb5a63344e0d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:19.396708 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c652a76a-239f-4c8d-85be-f2a1a57c8c03 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:19.397157 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c652a76a-239f-4c8d-85be-f2a1a57c8c03 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:19.397915 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c652a76a-239f-4c8d-85be-f2a1a57c8c03 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:19.398344 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c652a76a-239f-4c8d-85be-f2a1a57c8c03 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:19.534062 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-c652a76a-239f-4c8d-85be-f2a1a57c8c03 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a394fc62e6a64a85b855bf2eb56b4b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a87feacfb84d6c9f7ea48f230753b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:19.549993 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-c652a76a-239f-4c8d-85be-f2a1a57c8c03 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "GET /compute/v2.1/servers/3cc6d1fb-02b4-411e-84a2-eb5a63344e0d" status: 200 len: 1575 microversion: 2.1 time: 0.163942 Jun 22 10:27:19.551483 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 288/597] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:27:19 2022] GET /compute/v2.1/servers/3cc6d1fb-02b4-411e-84a2-eb5a63344e0d => generated 1575 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:27:19.688671 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-0300262e-7509-4496-a98c-12478cdebe3b tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:19.689359 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-0300262e-7509-4496-a98c-12478cdebe3b tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: da28df11-c078-43d5-81c4-e78ccf9f6504] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:19.696063 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0300262e-7509-4496-a98c-12478cdebe3b tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:19.696503 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0300262e-7509-4496-a98c-12478cdebe3b tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:19.697265 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0300262e-7509-4496-a98c-12478cdebe3b tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:19.697695 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0300262e-7509-4496-a98c-12478cdebe3b tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:19.836042 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-0300262e-7509-4496-a98c-12478cdebe3b tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:19.844140 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-0300262e-7509-4496-a98c-12478cdebe3b tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504" status: 200 len: 1678 microversion: 2.1 time: 0.159683 Jun 22 10:27:19.844669 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 310/598] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:27:19 2022] GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:27:20.575635 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-d7c52629-f4f6-454f-85f8-183c82f0c1fe tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:20.576580 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-d7c52629-f4f6-454f-85f8-183c82f0c1fe tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 3cc6d1fb-02b4-411e-84a2-eb5a63344e0d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:20.585846 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d7c52629-f4f6-454f-85f8-183c82f0c1fe tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:20.586286 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d7c52629-f4f6-454f-85f8-183c82f0c1fe tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:20.587098 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d7c52629-f4f6-454f-85f8-183c82f0c1fe tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:20.587526 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d7c52629-f4f6-454f-85f8-183c82f0c1fe tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:20.725046 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-d7c52629-f4f6-454f-85f8-183c82f0c1fe tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a394fc62e6a64a85b855bf2eb56b4b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a87feacfb84d6c9f7ea48f230753b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:20.732908 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-d7c52629-f4f6-454f-85f8-183c82f0c1fe tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "GET /compute/v2.1/servers/3cc6d1fb-02b4-411e-84a2-eb5a63344e0d" status: 200 len: 1575 microversion: 2.1 time: 0.163288 Jun 22 10:27:20.733477 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 289/599] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:27:20 2022] GET /compute/v2.1/servers/3cc6d1fb-02b4-411e-84a2-eb5a63344e0d => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:27:20.862130 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-79dc4c32-2b22-4391-8c13-be30709e830b tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:20.862759 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-79dc4c32-2b22-4391-8c13-be30709e830b tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: da28df11-c078-43d5-81c4-e78ccf9f6504] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:20.869977 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-79dc4c32-2b22-4391-8c13-be30709e830b tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:20.870432 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-79dc4c32-2b22-4391-8c13-be30709e830b tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:20.871248 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-79dc4c32-2b22-4391-8c13-be30709e830b tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:20.871689 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-79dc4c32-2b22-4391-8c13-be30709e830b tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:21.006793 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-79dc4c32-2b22-4391-8c13-be30709e830b tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:21.015025 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-79dc4c32-2b22-4391-8c13-be30709e830b tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504" status: 200 len: 1678 microversion: 2.1 time: 0.157386 Jun 22 10:27:21.015719 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 311/600] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:27:20 2022] GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:27:21.751805 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-b7d9930d-0a7c-4cde-a789-556cd9b2ab90 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:21.752672 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-b7d9930d-0a7c-4cde-a789-556cd9b2ab90 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 3cc6d1fb-02b4-411e-84a2-eb5a63344e0d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:21.761672 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b7d9930d-0a7c-4cde-a789-556cd9b2ab90 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:21.762387 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b7d9930d-0a7c-4cde-a789-556cd9b2ab90 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:21.763225 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b7d9930d-0a7c-4cde-a789-556cd9b2ab90 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:21.763653 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b7d9930d-0a7c-4cde-a789-556cd9b2ab90 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:21.990359 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-b7d9930d-0a7c-4cde-a789-556cd9b2ab90 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a394fc62e6a64a85b855bf2eb56b4b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a87feacfb84d6c9f7ea48f230753b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:21.998121 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-b7d9930d-0a7c-4cde-a789-556cd9b2ab90 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "GET /compute/v2.1/servers/3cc6d1fb-02b4-411e-84a2-eb5a63344e0d" status: 200 len: 1575 microversion: 2.1 time: 0.251498 Jun 22 10:27:21.998792 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 290/601] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:27:21 2022] GET /compute/v2.1/servers/3cc6d1fb-02b4-411e-84a2-eb5a63344e0d => generated 1575 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:27:22.032974 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-523d208a-1da8-4a8d-a8a2-6be901d445d7 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:22.033556 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-523d208a-1da8-4a8d-a8a2-6be901d445d7 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: da28df11-c078-43d5-81c4-e78ccf9f6504] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:22.040647 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-523d208a-1da8-4a8d-a8a2-6be901d445d7 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:22.041095 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-523d208a-1da8-4a8d-a8a2-6be901d445d7 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:22.041862 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-523d208a-1da8-4a8d-a8a2-6be901d445d7 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:22.042272 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-523d208a-1da8-4a8d-a8a2-6be901d445d7 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:22.288088 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-523d208a-1da8-4a8d-a8a2-6be901d445d7 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:22.295824 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-523d208a-1da8-4a8d-a8a2-6be901d445d7 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504" status: 200 len: 1678 microversion: 2.1 time: 0.267135 Jun 22 10:27:22.296401 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 312/602] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:27:22 2022] GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504 => generated 1678 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:27:22.609156 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-12ae06c1-9111-4104-9c26-3dc4e8392deb req-5c1be506-fce8-4bbc-b77a-c104967b2d85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cc6d1fb-02b4-411e-84a2-eb5a63344e0d", "name": "network-vif-deleted", "tag": "929e1349-8efe-439a-9035-3dbc4bc6c6a8"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:27:22.625065 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-12ae06c1-9111-4104-9c26-3dc4e8392deb req-5c1be506-fce8-4bbc-b77a-c104967b2d85 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:22.625856 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-12ae06c1-9111-4104-9c26-3dc4e8392deb req-5c1be506-fce8-4bbc-b77a-c104967b2d85 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:22.646751 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-12ae06c1-9111-4104-9c26-3dc4e8392deb req-5c1be506-fce8-4bbc-b77a-c104967b2d85 service nova] Creating event network-vif-deleted:929e1349-8efe-439a-9035-3dbc4bc6c6a8 for instance 3cc6d1fb-02b4-411e-84a2-eb5a63344e0d on hv-cinder-84713 Jun 22 10:27:22.652990 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-12ae06c1-9111-4104-9c26-3dc4e8392deb req-5c1be506-fce8-4bbc-b77a-c104967b2d85 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134163 Jun 22 10:27:22.654033 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 291/603] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:27:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:27:23.017517 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-403fe879-e26a-4792-b46a-665cde5989d3 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:23.018162 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-403fe879-e26a-4792-b46a-665cde5989d3 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 3cc6d1fb-02b4-411e-84a2-eb5a63344e0d] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:23.024503 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-403fe879-e26a-4792-b46a-665cde5989d3 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:23.024946 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-403fe879-e26a-4792-b46a-665cde5989d3 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:23.025722 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-403fe879-e26a-4792-b46a-665cde5989d3 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:23.026211 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-403fe879-e26a-4792-b46a-665cde5989d3 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:23.059599 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-403fe879-e26a-4792-b46a-665cde5989d3 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:23.060253 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-403fe879-e26a-4792-b46a-665cde5989d3 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:23.060493 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.objects.instance [None req-403fe879-e26a-4792-b46a-665cde5989d3 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lazy-loading 'fault' on Instance uuid 3cc6d1fb-02b4-411e-84a2-eb5a63344e0d {{(pid=117680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:27:23.103874 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-403fe879-e26a-4792-b46a-665cde5989d3 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a394fc62e6a64a85b855bf2eb56b4b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a87feacfb84d6c9f7ea48f230753b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:23.112028 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-403fe879-e26a-4792-b46a-665cde5989d3 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "GET /compute/v2.1/servers/3cc6d1fb-02b4-411e-84a2-eb5a63344e0d" status: 200 len: 1228 microversion: 2.1 time: 0.098837 Jun 22 10:27:23.112580 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 313/604] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:27:23 2022] GET /compute/v2.1/servers/3cc6d1fb-02b4-411e-84a2-eb5a63344e0d => generated 1228 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:27:23.314197 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-bc5dec7b-aa8b-4ac8-a602-2f85175c972e tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:23.315215 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-bc5dec7b-aa8b-4ac8-a602-2f85175c972e tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: da28df11-c078-43d5-81c4-e78ccf9f6504] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:23.324326 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-bc5dec7b-aa8b-4ac8-a602-2f85175c972e tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:23.325832 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-bc5dec7b-aa8b-4ac8-a602-2f85175c972e tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:23.328452 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-bc5dec7b-aa8b-4ac8-a602-2f85175c972e tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:23.329558 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-bc5dec7b-aa8b-4ac8-a602-2f85175c972e tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:23.483073 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-bc5dec7b-aa8b-4ac8-a602-2f85175c972e tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:23.491177 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-bc5dec7b-aa8b-4ac8-a602-2f85175c972e tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504" status: 200 len: 1678 microversion: 2.1 time: 0.181375 Jun 22 10:27:23.494892 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 292/605] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:27:23 2022] GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504 => generated 1678 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:27:24.139424 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-748a99c2-ef02-44f2-abd9-cf54575a44c3 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:24.140341 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-748a99c2-ef02-44f2-abd9-cf54575a44c3 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 3cc6d1fb-02b4-411e-84a2-eb5a63344e0d] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:24.149104 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-748a99c2-ef02-44f2-abd9-cf54575a44c3 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:24.149472 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-748a99c2-ef02-44f2-abd9-cf54575a44c3 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:24.150243 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-748a99c2-ef02-44f2-abd9-cf54575a44c3 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:24.150711 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-748a99c2-ef02-44f2-abd9-cf54575a44c3 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:24.164513 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.wsgi [None req-748a99c2-ef02-44f2-abd9-cf54575a44c3 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] HTTP exception thrown: Instance 3cc6d1fb-02b4-411e-84a2-eb5a63344e0d could not be found. Jun 22 10:27:24.166162 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-748a99c2-ef02-44f2-abd9-cf54575a44c3 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Request method failure captured: Jun 22 10:27:24.166162 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: request: GET /compute/v2.1/servers/3cc6d1fb-02b4-411e-84a2-eb5a63344e0d HTTP/1.1 Jun 22 10:27:24.166162 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Accept: application/json Jun 22 10:27:24.166162 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Accept-Encoding: identity Jun 22 10:27:24.166162 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Connection: close Jun 22 10:27:24.166162 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Content-Length: 0 Jun 22 10:27:24.166162 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Content-Type: application/json Jun 22 10:27:24.166162 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Host: 10.222.0.66 Jun 22 10:27:24.166162 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Openstack-System-Scope: None Jun 22 10:27:24.166162 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: User-Agent: python-urllib3/1.26.9 Jun 22 10:27:24.166162 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Auth-Token: gAAAAABisu1hytug7xP2j9RUJNGU87H2Yo7IxEXR9u7fu_LBOaV_q-xfR4gL2EA57uffwLCfFRfDDnIPlNf72rNz3G_3Pm4CJ99xXb8xpQIKUOzCbcLhgMBqZKgkTxEGrZBD1NtZuYmIKLZL9BApVW0LVQy4L9apbdMwQ5H09uY5fFaCygpiMyU Jun 22 10:27:24.166162 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Domain-Id: None Jun 22 10:27:24.166162 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Domain-Name: None Jun 22 10:27:24.166162 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Identity-Status: Confirmed Jun 22 10:27:24.166162 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Is-Admin-Project: True Jun 22 10:27:24.166162 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Domain-Id: default Jun 22 10:27:24.166162 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Domain-Name: Default Jun 22 10:27:24.166162 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Id: a4a87feacfb84d6c9f7ea48f230753b7 Jun 22 10:27:24.166162 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Name: tempest-TestVolumeBootPattern-1655045960 Jun 22 10:27:24.166162 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Role: member,reader Jun 22 10:27:24.166162 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Roles: member,reader Jun 22 10:27:24.167767 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_a4a87feacfb84d6c9f7ea48f230753b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a4a87feacfb84d6c9f7ea48f230753b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/a4a87feacfb84d6c9f7ea48f230753b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a4a87feacfb84d6c9f7ea48f230753b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}] Jun 22 10:27:24.167767 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant: tempest-TestVolumeBootPattern-1655045960 Jun 22 10:27:24.167767 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant-Id: a4a87feacfb84d6c9f7ea48f230753b7 Jun 22 10:27:24.167767 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant-Name: tempest-TestVolumeBootPattern-1655045960 Jun 22 10:27:24.167767 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User: tempest-TestVolumeBootPattern-1655045960-project Jun 22 10:27:24.167767 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Domain-Id: default Jun 22 10:27:24.167767 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Domain-Name: Default Jun 22 10:27:24.167767 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Id: a394fc62e6a64a85b855bf2eb56b4b71 Jun 22 10:27:24.167767 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Name: tempest-TestVolumeBootPattern-1655045960-project Jun 22 10:27:24.167767 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: method: > Jun 22 10:27:24.167767 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: exception: Instance 3cc6d1fb-02b4-411e-84a2-eb5a63344e0d could not be found. Jun 22 10:27:24.167767 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: action_args: {'id': '3cc6d1fb-02b4-411e-84a2-eb5a63344e0d'} Jun 22 10:27:24.168644 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:27:24.168644 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:27:24.168644 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:27:24.168644 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:27:24.168644 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:27:24.168644 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:27:24.168644 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:27:24.168644 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:27:24.168644 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:27:24.168644 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:27:24.168644 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cc6d1fb-02b4-411e-84a2-eb5a63344e0d could not be found. Jun 22 10:27:24.168644 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:27:24.168644 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:27:24.168644 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:27:24.168644 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:27:24.168644 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:27:24.168644 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:27:24.168644 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:27:24.168644 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:27:24.168644 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:27:24.169927 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:27:24.169927 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:27:24.169927 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:27:24.169927 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:27:24.169927 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:27:24.169927 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:27:24.169927 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:27:24.169927 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cc6d1fb-02b4-411e-84a2-eb5a63344e0d could not be found. Jun 22 10:27:24.169927 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:27:24.169927 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:27:24.169927 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:27:24.169927 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:27:24.169927 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:27:24.169927 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:27:24.169927 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:27:24.169927 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:27:24.169927 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cc6d1fb-02b4-411e-84a2-eb5a63344e0d could not be found. Jun 22 10:27:24.169927 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:27:24.171070 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-748a99c2-ef02-44f2-abd9-cf54575a44c3 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Returning 404 to user: Instance 3cc6d1fb-02b4-411e-84a2-eb5a63344e0d could not be found. {{(pid=117680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:27:24.171070 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-748a99c2-ef02-44f2-abd9-cf54575a44c3 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "GET /compute/v2.1/servers/3cc6d1fb-02b4-411e-84a2-eb5a63344e0d" status: 404 len: 111 microversion: 2.1 time: 0.034726 Jun 22 10:27:24.171070 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 314/606] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:27:24 2022] GET /compute/v2.1/servers/3cc6d1fb-02b4-411e-84a2-eb5a63344e0d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:27:24.275818 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-4b2767f0-c2bd-4c66-899e-c54062ba2b64 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-906255997", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-666635953", "security_groups": [{"name": "tempest-secgroup-smoke-1054534713"}], "block_device_mapping_v2": [{"uuid": "ce01a44b-1534-4b61-973f-2ec7c2800dac", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b0565ff5-0ad4-4a38-9f47-51304a15abc7"}]}} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:27:24.400140 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.network.neutron [None req-4b2767f0-c2bd-4c66-899e-c54062ba2b64 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] validate_networks() for [('b0565ff5-0ad4-4a38-9f47-51304a15abc7', None, None, None, None, None)] {{(pid=117679) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 10:27:24.508634 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-7847c9cc-433f-47b4-9452-2aa1a0afd701 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:24.509218 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-7847c9cc-433f-47b4-9452-2aa1a0afd701 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: da28df11-c078-43d5-81c4-e78ccf9f6504] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:24.515764 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7847c9cc-433f-47b4-9452-2aa1a0afd701 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:24.516211 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7847c9cc-433f-47b4-9452-2aa1a0afd701 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:24.517103 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7847c9cc-433f-47b4-9452-2aa1a0afd701 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:24.517541 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7847c9cc-433f-47b4-9452-2aa1a0afd701 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:24.747659 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-7847c9cc-433f-47b4-9452-2aa1a0afd701 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:24.756133 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-7847c9cc-433f-47b4-9452-2aa1a0afd701 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504" status: 200 len: 1655 microversion: 2.1 time: 0.251768 Jun 22 10:27:24.756700 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 315/607] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:27:24 2022] GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504 => generated 1655 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:27:24.774515 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-acc20adb-882f-4e39-9fec-c17c741a389f tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:27:24.781299 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-acc20adb-882f-4e39-9fec-c17c741a389f tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:24.781756 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-acc20adb-882f-4e39-9fec-c17c741a389f tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:24.804125 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-acc20adb-882f-4e39-9fec-c17c741a389f tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: da28df11-c078-43d5-81c4-e78ccf9f6504] Going to try to start instance {{(pid=117680) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 22 10:27:24.848784 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-acc20adb-882f-4e39-9fec-c17c741a389f tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "POST /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504/action" status: 202 len: 0 microversion: 2.1 time: 0.078082 Jun 22 10:27:24.852662 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 316/608] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Jun 22 10:27:24 2022] POST /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:27:24.859080 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-1936bb75-2807-4d7b-9c18-e7551ad63892 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:24.859794 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-1936bb75-2807-4d7b-9c18-e7551ad63892 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: da28df11-c078-43d5-81c4-e78ccf9f6504] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:24.861549 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-4b2767f0-c2bd-4c66-899e-c54062ba2b64 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Flavor limits 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 10:27:24.862193 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-4b2767f0-c2bd-4c66-899e-c54062ba2b64 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Image limits 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 10:27:24.862932 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-4b2767f0-c2bd-4c66-899e-c54062ba2b64 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Flavor pref 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 10:27:24.863334 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-4b2767f0-c2bd-4c66-899e-c54062ba2b64 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Image pref 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 10:27:24.863747 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-4b2767f0-c2bd-4c66-899e-c54062ba2b64 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 10:27:24.867707 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1936bb75-2807-4d7b-9c18-e7551ad63892 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:24.867707 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1936bb75-2807-4d7b-9c18-e7551ad63892 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:24.868555 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1936bb75-2807-4d7b-9c18-e7551ad63892 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:24.868970 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1936bb75-2807-4d7b-9c18-e7551ad63892 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:24.875394 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4b2767f0-c2bd-4c66-899e-c54062ba2b64 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:24.875849 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4b2767f0-c2bd-4c66-899e-c54062ba2b64 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:24.876898 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4b2767f0-c2bd-4c66-899e-c54062ba2b64 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:24.877329 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4b2767f0-c2bd-4c66-899e-c54062ba2b64 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:24.897467 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.quota [None req-4b2767f0-c2bd-4c66-899e-c54062ba2b64 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Getting quotas for project a4a87feacfb84d6c9f7ea48f230753b7. Resources: {'instances', 'cores', 'ram'} {{(pid=117679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:27:24.902429 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.quota [None req-4b2767f0-c2bd-4c66-899e-c54062ba2b64 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Getting quotas for user a394fc62e6a64a85b855bf2eb56b4b71 and project a4a87feacfb84d6c9f7ea48f230753b7. Resources: {'instances', 'cores', 'ram'} {{(pid=117679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:27:24.970827 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-4b2767f0-c2bd-4c66-899e-c54062ba2b64 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Going to run 1 instances... {{(pid=117679) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 10:27:24.973011 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-4b2767f0-c2bd-4c66-899e-c54062ba2b64 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 360c07f1-5b2e-41c9-a44e-d547784cf097] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ce01a44b-1534-4b61-973f-2ec7c2800dac',volume_size=None,volume_type=None)] {{(pid=117679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 10:27:25.115937 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-4b2767f0-c2bd-4c66-899e-c54062ba2b64 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.844428 Jun 22 10:27:25.116916 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 293/609] 10.222.0.66 () {60 vars in 1146 bytes} [Wed Jun 22 10:27:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 846 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 10:27:25.127085 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-d786590d-adc7-4004-846b-d253c7d2c76a tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:25.127801 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-d786590d-adc7-4004-846b-d253c7d2c76a tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 360c07f1-5b2e-41c9-a44e-d547784cf097] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:25.301581 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-d786590d-adc7-4004-846b-d253c7d2c76a tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a394fc62e6a64a85b855bf2eb56b4b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a87feacfb84d6c9f7ea48f230753b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:25.308541 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-d786590d-adc7-4004-846b-d253c7d2c76a tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "GET /compute/v2.1/servers/360c07f1-5b2e-41c9-a44e-d547784cf097" status: 200 len: 1093 microversion: 2.1 time: 0.185406 Jun 22 10:27:25.309540 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 294/610] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:27:25 2022] GET /compute/v2.1/servers/360c07f1-5b2e-41c9-a44e-d547784cf097 => generated 1093 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:27:25.342701 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-1936bb75-2807-4d7b-9c18-e7551ad63892 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:25.350536 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-1936bb75-2807-4d7b-9c18-e7551ad63892 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504" status: 200 len: 1664 microversion: 2.1 time: 0.496308 Jun 22 10:27:25.351119 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 317/611] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:27:24 2022] GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504 => generated 1664 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:27:26.325543 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-cb579cad-1237-4e5c-a854-ff18cb8c77b8 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:26.327140 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-cb579cad-1237-4e5c-a854-ff18cb8c77b8 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 360c07f1-5b2e-41c9-a44e-d547784cf097] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:26.334526 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-cb579cad-1237-4e5c-a854-ff18cb8c77b8 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:26.335064 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-cb579cad-1237-4e5c-a854-ff18cb8c77b8 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:26.335905 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-cb579cad-1237-4e5c-a854-ff18cb8c77b8 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:26.336407 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-cb579cad-1237-4e5c-a854-ff18cb8c77b8 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:26.368226 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-bd5f119c-3008-401e-9bb2-b9811e9e5d74 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:26.368843 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-bd5f119c-3008-401e-9bb2-b9811e9e5d74 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: da28df11-c078-43d5-81c4-e78ccf9f6504] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:26.375521 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-bd5f119c-3008-401e-9bb2-b9811e9e5d74 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:26.375974 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-bd5f119c-3008-401e-9bb2-b9811e9e5d74 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:26.376752 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-bd5f119c-3008-401e-9bb2-b9811e9e5d74 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:26.377191 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-bd5f119c-3008-401e-9bb2-b9811e9e5d74 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:26.427757 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-cb579cad-1237-4e5c-a854-ff18cb8c77b8 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a394fc62e6a64a85b855bf2eb56b4b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a87feacfb84d6c9f7ea48f230753b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:26.436500 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-cb579cad-1237-4e5c-a854-ff18cb8c77b8 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "GET /compute/v2.1/servers/360c07f1-5b2e-41c9-a44e-d547784cf097" status: 200 len: 1209 microversion: 2.1 time: 0.114846 Jun 22 10:27:26.437084 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 295/612] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:27:26 2022] GET /compute/v2.1/servers/360c07f1-5b2e-41c9-a44e-d547784cf097 => generated 1209 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:27:26.611283 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-bd5f119c-3008-401e-9bb2-b9811e9e5d74 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:26.620375 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-bd5f119c-3008-401e-9bb2-b9811e9e5d74 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504" status: 200 len: 1664 microversion: 2.1 time: 0.255996 Jun 22 10:27:26.623323 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 318/613] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:27:26 2022] GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504 => generated 1664 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:27:27.454856 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-972c7f47-7c9b-44fd-9126-427cd60e5be1 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:27.455428 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-972c7f47-7c9b-44fd-9126-427cd60e5be1 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 360c07f1-5b2e-41c9-a44e-d547784cf097] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:27.462080 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-972c7f47-7c9b-44fd-9126-427cd60e5be1 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:27.462522 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-972c7f47-7c9b-44fd-9126-427cd60e5be1 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:27.463338 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-972c7f47-7c9b-44fd-9126-427cd60e5be1 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:27.463909 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-972c7f47-7c9b-44fd-9126-427cd60e5be1 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:27.638211 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-635142d8-ef66-442b-a51b-b8bb7cefc6b9 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:27.639002 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-635142d8-ef66-442b-a51b-b8bb7cefc6b9 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: da28df11-c078-43d5-81c4-e78ccf9f6504] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:27.646440 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-635142d8-ef66-442b-a51b-b8bb7cefc6b9 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:27.647071 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-635142d8-ef66-442b-a51b-b8bb7cefc6b9 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:27.647725 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-635142d8-ef66-442b-a51b-b8bb7cefc6b9 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:27.648127 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-635142d8-ef66-442b-a51b-b8bb7cefc6b9 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:27.695542 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-972c7f47-7c9b-44fd-9126-427cd60e5be1 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a394fc62e6a64a85b855bf2eb56b4b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a87feacfb84d6c9f7ea48f230753b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:27.704126 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-972c7f47-7c9b-44fd-9126-427cd60e5be1 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "GET /compute/v2.1/servers/360c07f1-5b2e-41c9-a44e-d547784cf097" status: 200 len: 1265 microversion: 2.1 time: 0.253863 Jun 22 10:27:27.710180 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 296/614] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:27:27 2022] GET /compute/v2.1/servers/360c07f1-5b2e-41c9-a44e-d547784cf097 => generated 1265 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:27:27.838460 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-635142d8-ef66-442b-a51b-b8bb7cefc6b9 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:27.848809 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-635142d8-ef66-442b-a51b-b8bb7cefc6b9 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504" status: 200 len: 1668 microversion: 2.1 time: 0.214469 Jun 22 10:27:27.849441 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 319/615] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:27:27 2022] GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504 => generated 1668 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:27:27.952261 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-c4423dab-c0ff-4e62-aec5-1f1185548598 req-ff6c6ade-4419-46ed-b321-e7e5e39f94e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "360c07f1-5b2e-41c9-a44e-d547784cf097", "tag": "2e43553e-4d3a-4e20-b17c-54a25459963b"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:27:27.963984 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-c4423dab-c0ff-4e62-aec5-1f1185548598 req-ff6c6ade-4419-46ed-b321-e7e5e39f94e2 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:27.964352 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-c4423dab-c0ff-4e62-aec5-1f1185548598 req-ff6c6ade-4419-46ed-b321-e7e5e39f94e2 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:27.978040 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-c4423dab-c0ff-4e62-aec5-1f1185548598 req-ff6c6ade-4419-46ed-b321-e7e5e39f94e2 service nova] Creating event network-changed:2e43553e-4d3a-4e20-b17c-54a25459963b for instance 360c07f1-5b2e-41c9-a44e-d547784cf097 on hv-cinder-84713 Jun 22 10:27:27.984427 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-c4423dab-c0ff-4e62-aec5-1f1185548598 req-ff6c6ade-4419-46ed-b321-e7e5e39f94e2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037122 Jun 22 10:27:27.985097 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 297/616] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:27:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:27:28.726083 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-4c8508ba-d3b8-49fc-8ce2-e92dbde80239 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:28.726746 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-4c8508ba-d3b8-49fc-8ce2-e92dbde80239 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 360c07f1-5b2e-41c9-a44e-d547784cf097] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:28.734186 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4c8508ba-d3b8-49fc-8ce2-e92dbde80239 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:28.734649 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4c8508ba-d3b8-49fc-8ce2-e92dbde80239 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:28.735446 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4c8508ba-d3b8-49fc-8ce2-e92dbde80239 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:28.735876 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4c8508ba-d3b8-49fc-8ce2-e92dbde80239 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:28.869123 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-4c8508ba-d3b8-49fc-8ce2-e92dbde80239 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a394fc62e6a64a85b855bf2eb56b4b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a87feacfb84d6c9f7ea48f230753b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:28.876777 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-4c8508ba-d3b8-49fc-8ce2-e92dbde80239 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "GET /compute/v2.1/servers/360c07f1-5b2e-41c9-a44e-d547784cf097" status: 200 len: 1265 microversion: 2.1 time: 0.156611 Jun 22 10:27:28.877347 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 320/617] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:27:28 2022] GET /compute/v2.1/servers/360c07f1-5b2e-41c9-a44e-d547784cf097 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:27:29.894633 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-5fda5291-64f7-42a4-b22c-4649b370f858 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:29.895961 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-5fda5291-64f7-42a4-b22c-4649b370f858 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 360c07f1-5b2e-41c9-a44e-d547784cf097] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:29.903144 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5fda5291-64f7-42a4-b22c-4649b370f858 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:29.903899 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5fda5291-64f7-42a4-b22c-4649b370f858 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:29.904674 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5fda5291-64f7-42a4-b22c-4649b370f858 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:29.905129 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5fda5291-64f7-42a4-b22c-4649b370f858 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:30.109546 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-5fda5291-64f7-42a4-b22c-4649b370f858 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a394fc62e6a64a85b855bf2eb56b4b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a87feacfb84d6c9f7ea48f230753b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:30.117411 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-5fda5291-64f7-42a4-b22c-4649b370f858 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "GET /compute/v2.1/servers/360c07f1-5b2e-41c9-a44e-d547784cf097" status: 200 len: 1265 microversion: 2.1 time: 0.227102 Jun 22 10:27:30.126653 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 298/618] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:27:29 2022] GET /compute/v2.1/servers/360c07f1-5b2e-41c9-a44e-d547784cf097 => generated 1265 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:27:31.135159 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-cace442a-cbd0-4ba5-a2c1-a32643b5102a tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:31.135761 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-cace442a-cbd0-4ba5-a2c1-a32643b5102a tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 360c07f1-5b2e-41c9-a44e-d547784cf097] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:31.142851 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-cace442a-cbd0-4ba5-a2c1-a32643b5102a tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:31.143304 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-cace442a-cbd0-4ba5-a2c1-a32643b5102a tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:31.144072 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-cace442a-cbd0-4ba5-a2c1-a32643b5102a tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:31.144513 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-cace442a-cbd0-4ba5-a2c1-a32643b5102a tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:31.279628 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-cace442a-cbd0-4ba5-a2c1-a32643b5102a tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a394fc62e6a64a85b855bf2eb56b4b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a87feacfb84d6c9f7ea48f230753b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:31.287462 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-cace442a-cbd0-4ba5-a2c1-a32643b5102a tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "GET /compute/v2.1/servers/360c07f1-5b2e-41c9-a44e-d547784cf097" status: 200 len: 1265 microversion: 2.1 time: 0.156250 Jun 22 10:27:31.288058 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 321/619] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:27:31 2022] GET /compute/v2.1/servers/360c07f1-5b2e-41c9-a44e-d547784cf097 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:27:32.359493 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-8f5c8f44-869b-4501-abe0-1e1ac9776c61 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:32.360109 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-8f5c8f44-869b-4501-abe0-1e1ac9776c61 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 360c07f1-5b2e-41c9-a44e-d547784cf097] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:32.366491 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8f5c8f44-869b-4501-abe0-1e1ac9776c61 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:32.366985 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8f5c8f44-869b-4501-abe0-1e1ac9776c61 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:32.367762 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8f5c8f44-869b-4501-abe0-1e1ac9776c61 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:32.368196 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8f5c8f44-869b-4501-abe0-1e1ac9776c61 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:32.506565 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-8f5c8f44-869b-4501-abe0-1e1ac9776c61 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a394fc62e6a64a85b855bf2eb56b4b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a87feacfb84d6c9f7ea48f230753b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:32.518695 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-8f5c8f44-869b-4501-abe0-1e1ac9776c61 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "GET /compute/v2.1/servers/360c07f1-5b2e-41c9-a44e-d547784cf097" status: 200 len: 1265 microversion: 2.1 time: 0.216483 Jun 22 10:27:32.519463 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 299/620] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:27:32 2022] GET /compute/v2.1/servers/360c07f1-5b2e-41c9-a44e-d547784cf097 => generated 1265 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:27:33.537447 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-53481b7f-9c12-4445-82c9-00a9049d2794 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:33.538030 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-53481b7f-9c12-4445-82c9-00a9049d2794 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 360c07f1-5b2e-41c9-a44e-d547784cf097] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:33.545193 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-53481b7f-9c12-4445-82c9-00a9049d2794 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:33.545746 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-53481b7f-9c12-4445-82c9-00a9049d2794 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:33.546425 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-53481b7f-9c12-4445-82c9-00a9049d2794 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:33.546896 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-53481b7f-9c12-4445-82c9-00a9049d2794 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:33.572849 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:27:33.704077 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-53481b7f-9c12-4445-82c9-00a9049d2794 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a394fc62e6a64a85b855bf2eb56b4b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a87feacfb84d6c9f7ea48f230753b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:33.715180 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-53481b7f-9c12-4445-82c9-00a9049d2794 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "GET /compute/v2.1/servers/360c07f1-5b2e-41c9-a44e-d547784cf097" status: 200 len: 1265 microversion: 2.1 time: 0.181541 Jun 22 10:27:33.715894 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 322/621] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:27:33 2022] GET /compute/v2.1/servers/360c07f1-5b2e-41c9-a44e-d547784cf097 => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:27:34.734721 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-08e10dd9-3705-427e-836c-bb6387b5d7de tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:34.735370 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-08e10dd9-3705-427e-836c-bb6387b5d7de tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 360c07f1-5b2e-41c9-a44e-d547784cf097] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:34.743760 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-08e10dd9-3705-427e-836c-bb6387b5d7de tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:34.744198 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-08e10dd9-3705-427e-836c-bb6387b5d7de tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:34.744956 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-08e10dd9-3705-427e-836c-bb6387b5d7de tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:34.745382 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-08e10dd9-3705-427e-836c-bb6387b5d7de tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:34.886839 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_cell0:SELECT=2 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:27:34.891177 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-08e10dd9-3705-427e-836c-bb6387b5d7de tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a394fc62e6a64a85b855bf2eb56b4b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a87feacfb84d6c9f7ea48f230753b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:34.902047 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-08e10dd9-3705-427e-836c-bb6387b5d7de tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "GET /compute/v2.1/servers/360c07f1-5b2e-41c9-a44e-d547784cf097" status: 200 len: 1265 microversion: 2.1 time: 0.172464 Jun 22 10:27:34.902705 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 300/622] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:27:34 2022] GET /compute/v2.1/servers/360c07f1-5b2e-41c9-a44e-d547784cf097 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:27:35.924766 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-339b1302-b67d-4273-be28-f0ed2a8f7eba tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:35.925595 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-339b1302-b67d-4273-be28-f0ed2a8f7eba tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 360c07f1-5b2e-41c9-a44e-d547784cf097] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:35.933409 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-339b1302-b67d-4273-be28-f0ed2a8f7eba tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:35.933864 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-339b1302-b67d-4273-be28-f0ed2a8f7eba tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:35.934673 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-339b1302-b67d-4273-be28-f0ed2a8f7eba tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:35.935113 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-339b1302-b67d-4273-be28-f0ed2a8f7eba tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:36.070333 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-339b1302-b67d-4273-be28-f0ed2a8f7eba tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a394fc62e6a64a85b855bf2eb56b4b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a87feacfb84d6c9f7ea48f230753b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:36.078868 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-339b1302-b67d-4273-be28-f0ed2a8f7eba tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "GET /compute/v2.1/servers/360c07f1-5b2e-41c9-a44e-d547784cf097" status: 200 len: 1265 microversion: 2.1 time: 0.159560 Jun 22 10:27:36.079480 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 323/623] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:27:35 2022] GET /compute/v2.1/servers/360c07f1-5b2e-41c9-a44e-d547784cf097 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:27:37.098472 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-83f1e9a4-96d7-43e2-887d-db59bfe0ea46 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:37.100311 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-83f1e9a4-96d7-43e2-887d-db59bfe0ea46 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 360c07f1-5b2e-41c9-a44e-d547784cf097] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:37.102368 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_cell0:SELECT=8 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:27:37.109021 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-83f1e9a4-96d7-43e2-887d-db59bfe0ea46 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:37.109471 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-83f1e9a4-96d7-43e2-887d-db59bfe0ea46 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:37.110378 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-83f1e9a4-96d7-43e2-887d-db59bfe0ea46 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:37.110823 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-83f1e9a4-96d7-43e2-887d-db59bfe0ea46 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:37.256472 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-83f1e9a4-96d7-43e2-887d-db59bfe0ea46 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a394fc62e6a64a85b855bf2eb56b4b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a87feacfb84d6c9f7ea48f230753b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:37.264249 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-83f1e9a4-96d7-43e2-887d-db59bfe0ea46 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "GET /compute/v2.1/servers/360c07f1-5b2e-41c9-a44e-d547784cf097" status: 200 len: 1265 microversion: 2.1 time: 0.170912 Jun 22 10:27:37.264833 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 301/624] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:27:37 2022] GET /compute/v2.1/servers/360c07f1-5b2e-41c9-a44e-d547784cf097 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:27:38.282686 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-e7e7cfe9-a153-4762-96f7-4746feb53f37 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:38.283514 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-e7e7cfe9-a153-4762-96f7-4746feb53f37 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 360c07f1-5b2e-41c9-a44e-d547784cf097] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:38.290323 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e7e7cfe9-a153-4762-96f7-4746feb53f37 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:38.290794 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e7e7cfe9-a153-4762-96f7-4746feb53f37 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:38.291647 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e7e7cfe9-a153-4762-96f7-4746feb53f37 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:38.292001 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e7e7cfe9-a153-4762-96f7-4746feb53f37 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:38.434101 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-e7e7cfe9-a153-4762-96f7-4746feb53f37 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a394fc62e6a64a85b855bf2eb56b4b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a87feacfb84d6c9f7ea48f230753b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:38.442009 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-e7e7cfe9-a153-4762-96f7-4746feb53f37 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "GET /compute/v2.1/servers/360c07f1-5b2e-41c9-a44e-d547784cf097" status: 200 len: 1265 microversion: 2.1 time: 0.164129 Jun 22 10:27:38.442608 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 324/625] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:27:38 2022] GET /compute/v2.1/servers/360c07f1-5b2e-41c9-a44e-d547784cf097 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:27:38.591562 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-dc832583-b198-4456-a1ab-59c98f76c8e9 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:38.592476 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-dc832583-b198-4456-a1ab-59c98f76c8e9 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: 752de513-d1ba-43b2-b68d-912134b1d215] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:38.600715 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-dc832583-b198-4456-a1ab-59c98f76c8e9 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:38.601163 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-dc832583-b198-4456-a1ab-59c98f76c8e9 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:38.601932 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-dc832583-b198-4456-a1ab-59c98f76c8e9 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:38.602365 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-dc832583-b198-4456-a1ab-59c98f76c8e9 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:38.625970 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-dc832583-b198-4456-a1ab-59c98f76c8e9 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/752de513-d1ba-43b2-b68d-912134b1d215/ips" status: 200 len: 150 microversion: 2.1 time: 0.039747 Jun 22 10:27:38.626578 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 302/626] 10.222.0.66 () {58 vars in 1247 bytes} [Wed Jun 22 10:27:38 2022] GET /compute/v2.1/servers/752de513-d1ba-43b2-b68d-912134b1d215/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:27:38.637891 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-e533eecc-c1fa-4979-af38-a46ab9601500 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2ac05241-ea18-4902-9d40-ed08ff278b9e"}} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:27:38.639073 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-e533eecc-c1fa-4979-af38-a46ab9601500 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: 752de513-d1ba-43b2-b68d-912134b1d215] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:38.647086 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e533eecc-c1fa-4979-af38-a46ab9601500 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:38.647597 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e533eecc-c1fa-4979-af38-a46ab9601500 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:38.648435 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e533eecc-c1fa-4979-af38-a46ab9601500 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:38.648869 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e533eecc-c1fa-4979-af38-a46ab9601500 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:38.736536 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.wsgi [None req-e533eecc-c1fa-4979-af38-a46ab9601500 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] HTTP exception thrown: Invalid volume: volume 2ac05241-ea18-4902-9d40-ed08ff278b9e is already attached to instances: c9505087-b458-46dc-9fbb-ee4ef61decde Jun 22 10:27:38.738967 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-e533eecc-c1fa-4979-af38-a46ab9601500 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Request method failure captured: Jun 22 10:27:38.738967 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: request: POST /compute/v2.1/servers/752de513-d1ba-43b2-b68d-912134b1d215/os-volume_attachments HTTP/1.1 Jun 22 10:27:38.738967 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Accept: application/json Jun 22 10:27:38.738967 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Accept-Encoding: identity Jun 22 10:27:38.738967 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Connection: close Jun 22 10:27:38.738967 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Content-Length: 74 Jun 22 10:27:38.738967 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Content-Type: application/json Jun 22 10:27:38.738967 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Host: 10.222.0.66 Jun 22 10:27:38.738967 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Openstack-System-Scope: None Jun 22 10:27:38.738967 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: User-Agent: python-urllib3/1.26.9 Jun 22 10:27:38.738967 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Auth-Token: gAAAAABisu0Ck1QB2Lvyg9V3u3kBIuXEDJgkZ8XS4Rgzd5ukw0XPlYur1JC85E1WWEVd6k3S8eI6-t0Re7y4TmCuzTPaStOxInH_tNEfhxW9RG6_giYUrX4Dn5Ql7KnDFRmmntDTB2iztYRLelndnkJ5B_3DXuocSGsy72opKKw0vOKEx9YRw_Y Jun 22 10:27:38.738967 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Domain-Id: None Jun 22 10:27:38.738967 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Domain-Name: None Jun 22 10:27:38.738967 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Identity-Status: Confirmed Jun 22 10:27:38.738967 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Is-Admin-Project: True Jun 22 10:27:38.738967 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Domain-Id: default Jun 22 10:27:38.738967 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Domain-Name: Default Jun 22 10:27:38.738967 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Id: 1db3fe97f51f47a98da3cbc8f0d55741 Jun 22 10:27:38.738967 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Name: tempest-AttachVolumeNegativeTest-873283835 Jun 22 10:27:38.738967 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Role: member,reader Jun 22 10:27:38.738967 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Roles: member,reader Jun 22 10:27:38.741262 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_1db3fe97f51f47a98da3cbc8f0d55741"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1db3fe97f51f47a98da3cbc8f0d55741"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/1db3fe97f51f47a98da3cbc8f0d55741"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1db3fe97f51f47a98da3cbc8f0d55741"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}] Jun 22 10:27:38.741262 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant: tempest-AttachVolumeNegativeTest-873283835 Jun 22 10:27:38.741262 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant-Id: 1db3fe97f51f47a98da3cbc8f0d55741 Jun 22 10:27:38.741262 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-873283835 Jun 22 10:27:38.741262 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User: tempest-AttachVolumeNegativeTest-873283835-project Jun 22 10:27:38.741262 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Domain-Id: default Jun 22 10:27:38.741262 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Domain-Name: Default Jun 22 10:27:38.741262 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Id: da80b9a52feb462faf0469f2ab701fb8 Jun 22 10:27:38.741262 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Name: tempest-AttachVolumeNegativeTest-873283835-project Jun 22 10:27:38.741262 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Jun 22 10:27:38.741262 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: {"volumeAttachment": {"volumeId": "2ac05241-ea18-4902-9d40-ed08ff278b9e"}} Jun 22 10:27:38.741262 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: method: > Jun 22 10:27:38.742150 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: exception: Invalid volume: volume 2ac05241-ea18-4902-9d40-ed08ff278b9e is already attached to instances: c9505087-b458-46dc-9fbb-ee4ef61decde Jun 22 10:27:38.742150 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: action_args: {'server_id': '752de513-d1ba-43b2-b68d-912134b1d215', 'body': {'volumeAttachment': {'volumeId': '2ac05241-ea18-4902-9d40-ed08ff278b9e'}}} Jun 22 10:27:38.742150 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:27:38.742150 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:27:38.742150 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 22 10:27:38.742150 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 22 10:27:38.742150 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 22 10:27:38.742150 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 22 10:27:38.742150 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 22 10:27:38.742150 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 22 10:27:38.742150 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 22 10:27:38.742150 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 22 10:27:38.742150 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 22 10:27:38.742150 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 22 10:27:38.742150 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 2ac05241-ea18-4902-9d40-ed08ff278b9e is already attached to instances: c9505087-b458-46dc-9fbb-ee4ef61decde Jun 22 10:27:38.742150 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:27:38.742150 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:27:38.742150 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:27:38.742150 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:27:38.743477 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:27:38.743477 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:27:38.743477 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:27:38.743477 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:27:38.743477 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:27:38.743477 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:27:38.743477 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 10:27:38.743477 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 10:27:38.743477 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 10:27:38.743477 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 10:27:38.743477 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 10:27:38.743477 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 10:27:38.743477 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 22 10:27:38.743477 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 22 10:27:38.743477 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 2ac05241-ea18-4902-9d40-ed08ff278b9e is already attached to instances: c9505087-b458-46dc-9fbb-ee4ef61decde Jun 22 10:27:38.743477 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:27:38.743477 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:27:38.743477 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:27:38.743477 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:27:38.743477 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:27:38.744703 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:27:38.744703 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:27:38.744703 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:27:38.744703 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 2ac05241-ea18-4902-9d40-ed08ff278b9e is already attached to instances: c9505087-b458-46dc-9fbb-ee4ef61decde Jun 22 10:27:38.744703 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:27:38.744703 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-e533eecc-c1fa-4979-af38-a46ab9601500 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Returning 400 to user: Invalid volume: volume 2ac05241-ea18-4902-9d40-ed08ff278b9e is already attached to instances: c9505087-b458-46dc-9fbb-ee4ef61decde {{(pid=117680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:27:38.744703 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-e533eecc-c1fa-4979-af38-a46ab9601500 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "POST /compute/v2.1/servers/752de513-d1ba-43b2-b68d-912134b1d215/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.107991 Jun 22 10:27:38.746043 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 325/627] 10.222.0.66 () {60 vars in 1322 bytes} [Wed Jun 22 10:27:38 2022] POST /compute/v2.1/servers/752de513-d1ba-43b2-b68d-912134b1d215/os-volume_attachments => generated 174 bytes in 113 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 22 10:27:38.755581 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-628227e7-e390-48e4-9243-67b220e2980b tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:38.756524 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-628227e7-e390-48e4-9243-67b220e2980b tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: 752de513-d1ba-43b2-b68d-912134b1d215] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:38.763088 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-628227e7-e390-48e4-9243-67b220e2980b tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:38.763535 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-628227e7-e390-48e4-9243-67b220e2980b tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:38.764297 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-628227e7-e390-48e4-9243-67b220e2980b tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:38.769819 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-628227e7-e390-48e4-9243-67b220e2980b tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:38.789950 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_cell1:SELECT=100 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:27:38.797922 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-628227e7-e390-48e4-9243-67b220e2980b tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: 752de513-d1ba-43b2-b68d-912134b1d215] Going to try to terminate instance {{(pid=117679) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 10:27:38.878706 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-628227e7-e390-48e4-9243-67b220e2980b tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "DELETE /compute/v2.1/servers/752de513-d1ba-43b2-b68d-912134b1d215" status: 204 len: 0 microversion: 2.1 time: 0.127596 Jun 22 10:27:38.879337 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 303/628] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Jun 22 10:27:38 2022] DELETE /compute/v2.1/servers/752de513-d1ba-43b2-b68d-912134b1d215 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 10:27:38.887622 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-6de6bb92-5c11-4c6f-84e2-1c11aa59cb8f tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:38.888347 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-6de6bb92-5c11-4c6f-84e2-1c11aa59cb8f tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: 752de513-d1ba-43b2-b68d-912134b1d215] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:38.895614 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6de6bb92-5c11-4c6f-84e2-1c11aa59cb8f tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:38.896052 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6de6bb92-5c11-4c6f-84e2-1c11aa59cb8f tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:38.897016 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6de6bb92-5c11-4c6f-84e2-1c11aa59cb8f tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:38.897624 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6de6bb92-5c11-4c6f-84e2-1c11aa59cb8f tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:39.043037 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-6de6bb92-5c11-4c6f-84e2-1c11aa59cb8f tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:39.052492 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-6de6bb92-5c11-4c6f-84e2-1c11aa59cb8f tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/752de513-d1ba-43b2-b68d-912134b1d215" status: 200 len: 1682 microversion: 2.1 time: 0.168629 Jun 22 10:27:39.053103 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 326/629] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:27:38 2022] GET /compute/v2.1/servers/752de513-d1ba-43b2-b68d-912134b1d215 => generated 1682 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:27:39.235723 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-0089b3b6-5327-4798-b50c-3ac237f9199c req-e49118c3-f927-4180-bb8a-555b75c1167a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "360c07f1-5b2e-41c9-a44e-d547784cf097", "name": "network-vif-plugged", "status": "completed", "tag": "2e43553e-4d3a-4e20-b17c-54a25459963b"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:27:39.245998 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-0089b3b6-5327-4798-b50c-3ac237f9199c req-e49118c3-f927-4180-bb8a-555b75c1167a service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:39.246541 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-0089b3b6-5327-4798-b50c-3ac237f9199c req-e49118c3-f927-4180-bb8a-555b75c1167a service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:39.259141 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-0089b3b6-5327-4798-b50c-3ac237f9199c req-e49118c3-f927-4180-bb8a-555b75c1167a service nova] Creating event network-vif-plugged:2e43553e-4d3a-4e20-b17c-54a25459963b for instance 360c07f1-5b2e-41c9-a44e-d547784cf097 on hv-cinder-84713 Jun 22 10:27:39.264156 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-0089b3b6-5327-4798-b50c-3ac237f9199c req-e49118c3-f927-4180-bb8a-555b75c1167a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032766 Jun 22 10:27:39.264801 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 304/630] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:27:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:27:39.459397 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-07bdc691-16c3-4aa5-b988-f3f79ed24085 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:39.460383 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-07bdc691-16c3-4aa5-b988-f3f79ed24085 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 360c07f1-5b2e-41c9-a44e-d547784cf097] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:39.467548 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-07bdc691-16c3-4aa5-b988-f3f79ed24085 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:39.467993 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-07bdc691-16c3-4aa5-b988-f3f79ed24085 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:39.468771 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-07bdc691-16c3-4aa5-b988-f3f79ed24085 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:39.469184 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-07bdc691-16c3-4aa5-b988-f3f79ed24085 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:39.611185 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-07bdc691-16c3-4aa5-b988-f3f79ed24085 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a394fc62e6a64a85b855bf2eb56b4b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a87feacfb84d6c9f7ea48f230753b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:39.619144 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-07bdc691-16c3-4aa5-b988-f3f79ed24085 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "GET /compute/v2.1/servers/360c07f1-5b2e-41c9-a44e-d547784cf097" status: 200 len: 1265 microversion: 2.1 time: 0.163843 Jun 22 10:27:39.619716 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 327/631] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:27:39 2022] GET /compute/v2.1/servers/360c07f1-5b2e-41c9-a44e-d547784cf097 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:27:40.070731 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-b34ec7df-ba0f-4457-93d1-412de43b9144 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:40.071388 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-b34ec7df-ba0f-4457-93d1-412de43b9144 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: 752de513-d1ba-43b2-b68d-912134b1d215] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:40.078158 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b34ec7df-ba0f-4457-93d1-412de43b9144 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:40.078629 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b34ec7df-ba0f-4457-93d1-412de43b9144 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:40.079370 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b34ec7df-ba0f-4457-93d1-412de43b9144 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:40.079782 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b34ec7df-ba0f-4457-93d1-412de43b9144 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:40.223109 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-b34ec7df-ba0f-4457-93d1-412de43b9144 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:40.230744 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-b34ec7df-ba0f-4457-93d1-412de43b9144 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/752de513-d1ba-43b2-b68d-912134b1d215" status: 200 len: 1682 microversion: 2.1 time: 0.164916 Jun 22 10:27:40.231276 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 305/632] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:27:40 2022] GET /compute/v2.1/servers/752de513-d1ba-43b2-b68d-912134b1d215 => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:27:40.639346 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-e605a256-fbe7-41d3-8934-e6ffe686055a tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:40.639953 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-e605a256-fbe7-41d3-8934-e6ffe686055a tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 360c07f1-5b2e-41c9-a44e-d547784cf097] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:40.647057 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e605a256-fbe7-41d3-8934-e6ffe686055a tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:40.647510 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e605a256-fbe7-41d3-8934-e6ffe686055a tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:40.648286 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e605a256-fbe7-41d3-8934-e6ffe686055a tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:40.648719 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e605a256-fbe7-41d3-8934-e6ffe686055a tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:40.780784 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-e605a256-fbe7-41d3-8934-e6ffe686055a tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a394fc62e6a64a85b855bf2eb56b4b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a87feacfb84d6c9f7ea48f230753b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:40.790495 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-e605a256-fbe7-41d3-8934-e6ffe686055a tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "GET /compute/v2.1/servers/360c07f1-5b2e-41c9-a44e-d547784cf097" status: 200 len: 1265 microversion: 2.1 time: 0.155084 Jun 22 10:27:40.791099 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 328/633] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:27:40 2022] GET /compute/v2.1/servers/360c07f1-5b2e-41c9-a44e-d547784cf097 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:27:41.248633 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-1c331997-09b7-4bdd-a0be-e3542a526d16 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:41.249207 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-1c331997-09b7-4bdd-a0be-e3542a526d16 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: 752de513-d1ba-43b2-b68d-912134b1d215] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:41.256925 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1c331997-09b7-4bdd-a0be-e3542a526d16 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:41.257377 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1c331997-09b7-4bdd-a0be-e3542a526d16 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:41.258171 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1c331997-09b7-4bdd-a0be-e3542a526d16 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:41.258622 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1c331997-09b7-4bdd-a0be-e3542a526d16 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:41.481203 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-1c331997-09b7-4bdd-a0be-e3542a526d16 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:41.491068 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-1c331997-09b7-4bdd-a0be-e3542a526d16 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/752de513-d1ba-43b2-b68d-912134b1d215" status: 200 len: 1682 microversion: 2.1 time: 0.246946 Jun 22 10:27:41.491787 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 306/634] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:27:41 2022] GET /compute/v2.1/servers/752de513-d1ba-43b2-b68d-912134b1d215 => generated 1682 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:27:41.810653 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-72fe318d-9063-48a4-9dbd-ee4e724ca7cb tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:41.811211 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-72fe318d-9063-48a4-9dbd-ee4e724ca7cb tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 360c07f1-5b2e-41c9-a44e-d547784cf097] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:41.821775 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-72fe318d-9063-48a4-9dbd-ee4e724ca7cb tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:41.822489 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-72fe318d-9063-48a4-9dbd-ee4e724ca7cb tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:41.823981 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-72fe318d-9063-48a4-9dbd-ee4e724ca7cb tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:41.824707 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-72fe318d-9063-48a4-9dbd-ee4e724ca7cb tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:41.922436 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-e4e11199-5b93-45fd-8242-f42e11db8542 req-a8e9b58e-ef6f-4e1b-9701-48d418dbadf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "752de513-d1ba-43b2-b68d-912134b1d215", "name": "network-vif-deleted", "tag": "57150168-15e9-4d54-980f-4f45dc8ded4a"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:27:41.934396 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-e4e11199-5b93-45fd-8242-f42e11db8542 req-a8e9b58e-ef6f-4e1b-9701-48d418dbadf9 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:41.935110 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-e4e11199-5b93-45fd-8242-f42e11db8542 req-a8e9b58e-ef6f-4e1b-9701-48d418dbadf9 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:41.952874 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-e4e11199-5b93-45fd-8242-f42e11db8542 req-a8e9b58e-ef6f-4e1b-9701-48d418dbadf9 service nova] Creating event network-vif-deleted:57150168-15e9-4d54-980f-4f45dc8ded4a for instance 752de513-d1ba-43b2-b68d-912134b1d215 on hv-cinder-84713 Jun 22 10:27:41.958678 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-e4e11199-5b93-45fd-8242-f42e11db8542 req-a8e9b58e-ef6f-4e1b-9701-48d418dbadf9 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045123 Jun 22 10:27:41.960712 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 307/635] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:27:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:27:42.262920 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-72fe318d-9063-48a4-9dbd-ee4e724ca7cb tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a394fc62e6a64a85b855bf2eb56b4b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a87feacfb84d6c9f7ea48f230753b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:42.270538 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-72fe318d-9063-48a4-9dbd-ee4e724ca7cb tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "GET /compute/v2.1/servers/360c07f1-5b2e-41c9-a44e-d547784cf097" status: 200 len: 1265 microversion: 2.1 time: 0.465956 Jun 22 10:27:42.271082 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 329/636] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:27:41 2022] GET /compute/v2.1/servers/360c07f1-5b2e-41c9-a44e-d547784cf097 => generated 1265 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:27:42.510689 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-db895e3d-507b-4721-b70f-46c72b6d03a9 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:42.511403 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-db895e3d-507b-4721-b70f-46c72b6d03a9 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: 752de513-d1ba-43b2-b68d-912134b1d215] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:42.518608 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-db895e3d-507b-4721-b70f-46c72b6d03a9 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:42.519093 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-db895e3d-507b-4721-b70f-46c72b6d03a9 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:42.519875 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-db895e3d-507b-4721-b70f-46c72b6d03a9 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:42.520312 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-db895e3d-507b-4721-b70f-46c72b6d03a9 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:42.554913 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-db895e3d-507b-4721-b70f-46c72b6d03a9 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:42.555378 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-db895e3d-507b-4721-b70f-46c72b6d03a9 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:42.555847 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.objects.instance [None req-db895e3d-507b-4721-b70f-46c72b6d03a9 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lazy-loading 'fault' on Instance uuid 752de513-d1ba-43b2-b68d-912134b1d215 {{(pid=117679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:27:42.596868 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-db895e3d-507b-4721-b70f-46c72b6d03a9 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:42.604704 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-db895e3d-507b-4721-b70f-46c72b6d03a9 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/752de513-d1ba-43b2-b68d-912134b1d215" status: 200 len: 1332 microversion: 2.1 time: 0.098215 Jun 22 10:27:42.614173 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 308/637] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:27:42 2022] GET /compute/v2.1/servers/752de513-d1ba-43b2-b68d-912134b1d215 => generated 1332 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:27:43.290169 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-f0be174e-af05-42e4-8350-52b33dad241a tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:43.291141 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-f0be174e-af05-42e4-8350-52b33dad241a tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 360c07f1-5b2e-41c9-a44e-d547784cf097] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:43.298928 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f0be174e-af05-42e4-8350-52b33dad241a tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:43.299619 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f0be174e-af05-42e4-8350-52b33dad241a tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:43.300782 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f0be174e-af05-42e4-8350-52b33dad241a tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:43.301489 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f0be174e-af05-42e4-8350-52b33dad241a tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:43.522284 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-f0be174e-af05-42e4-8350-52b33dad241a tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a394fc62e6a64a85b855bf2eb56b4b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a87feacfb84d6c9f7ea48f230753b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:43.530728 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-f0be174e-af05-42e4-8350-52b33dad241a tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "GET /compute/v2.1/servers/360c07f1-5b2e-41c9-a44e-d547784cf097" status: 200 len: 1452 microversion: 2.1 time: 0.246397 Jun 22 10:27:43.531307 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 330/638] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:27:43 2022] GET /compute/v2.1/servers/360c07f1-5b2e-41c9-a44e-d547784cf097 => generated 1452 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:27:43.547063 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-4550e5db-63cd-4809-980d-6f685cf092fd tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:43.547665 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-4550e5db-63cd-4809-980d-6f685cf092fd tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 360c07f1-5b2e-41c9-a44e-d547784cf097] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:43.554549 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4550e5db-63cd-4809-980d-6f685cf092fd tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:43.555009 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4550e5db-63cd-4809-980d-6f685cf092fd tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:43.555787 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4550e5db-63cd-4809-980d-6f685cf092fd tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:43.556204 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4550e5db-63cd-4809-980d-6f685cf092fd tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:43.622224 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-e0aab3a5-ecaf-40a7-9d65-94cda54eea57 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:43.622846 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-e0aab3a5-ecaf-40a7-9d65-94cda54eea57 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: 752de513-d1ba-43b2-b68d-912134b1d215] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:43.629780 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e0aab3a5-ecaf-40a7-9d65-94cda54eea57 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:43.630224 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e0aab3a5-ecaf-40a7-9d65-94cda54eea57 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:43.631109 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e0aab3a5-ecaf-40a7-9d65-94cda54eea57 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:43.631537 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e0aab3a5-ecaf-40a7-9d65-94cda54eea57 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:43.645665 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.wsgi [None req-e0aab3a5-ecaf-40a7-9d65-94cda54eea57 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] HTTP exception thrown: Instance 752de513-d1ba-43b2-b68d-912134b1d215 could not be found. Jun 22 10:27:43.647236 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-e0aab3a5-ecaf-40a7-9d65-94cda54eea57 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Request method failure captured: Jun 22 10:27:43.647236 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: request: GET /compute/v2.1/servers/752de513-d1ba-43b2-b68d-912134b1d215 HTTP/1.1 Jun 22 10:27:43.647236 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Accept: application/json Jun 22 10:27:43.647236 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Accept-Encoding: identity Jun 22 10:27:43.647236 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Connection: close Jun 22 10:27:43.647236 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Content-Length: 0 Jun 22 10:27:43.647236 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Content-Type: application/json Jun 22 10:27:43.647236 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Host: 10.222.0.66 Jun 22 10:27:43.647236 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Openstack-System-Scope: None Jun 22 10:27:43.647236 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: User-Agent: python-urllib3/1.26.9 Jun 22 10:27:43.647236 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Auth-Token: gAAAAABisu0Ck1QB2Lvyg9V3u3kBIuXEDJgkZ8XS4Rgzd5ukw0XPlYur1JC85E1WWEVd6k3S8eI6-t0Re7y4TmCuzTPaStOxInH_tNEfhxW9RG6_giYUrX4Dn5Ql7KnDFRmmntDTB2iztYRLelndnkJ5B_3DXuocSGsy72opKKw0vOKEx9YRw_Y Jun 22 10:27:43.647236 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Domain-Id: None Jun 22 10:27:43.647236 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Domain-Name: None Jun 22 10:27:43.647236 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Identity-Status: Confirmed Jun 22 10:27:43.647236 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Is-Admin-Project: True Jun 22 10:27:43.647236 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Domain-Id: default Jun 22 10:27:43.647236 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Domain-Name: Default Jun 22 10:27:43.647236 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Id: 1db3fe97f51f47a98da3cbc8f0d55741 Jun 22 10:27:43.647236 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Name: tempest-AttachVolumeNegativeTest-873283835 Jun 22 10:27:43.647236 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Role: member,reader Jun 22 10:27:43.647236 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Roles: member,reader Jun 22 10:27:43.649409 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_1db3fe97f51f47a98da3cbc8f0d55741"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1db3fe97f51f47a98da3cbc8f0d55741"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/1db3fe97f51f47a98da3cbc8f0d55741"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1db3fe97f51f47a98da3cbc8f0d55741"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}] Jun 22 10:27:43.649409 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant: tempest-AttachVolumeNegativeTest-873283835 Jun 22 10:27:43.649409 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant-Id: 1db3fe97f51f47a98da3cbc8f0d55741 Jun 22 10:27:43.649409 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-873283835 Jun 22 10:27:43.649409 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User: tempest-AttachVolumeNegativeTest-873283835-project Jun 22 10:27:43.649409 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Domain-Id: default Jun 22 10:27:43.649409 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Domain-Name: Default Jun 22 10:27:43.649409 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Id: da80b9a52feb462faf0469f2ab701fb8 Jun 22 10:27:43.649409 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Name: tempest-AttachVolumeNegativeTest-873283835-project Jun 22 10:27:43.649409 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: method: > Jun 22 10:27:43.649409 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: exception: Instance 752de513-d1ba-43b2-b68d-912134b1d215 could not be found. Jun 22 10:27:43.649409 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: action_args: {'id': '752de513-d1ba-43b2-b68d-912134b1d215'} Jun 22 10:27:43.650178 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:27:43.650178 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:27:43.650178 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:27:43.650178 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:27:43.650178 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:27:43.650178 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:27:43.650178 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:27:43.650178 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:27:43.650178 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:27:43.650178 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:27:43.650178 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 752de513-d1ba-43b2-b68d-912134b1d215 could not be found. Jun 22 10:27:43.650178 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:27:43.650178 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:27:43.650178 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:27:43.650178 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:27:43.650178 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:27:43.650178 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:27:43.650178 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:27:43.650178 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:27:43.650178 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:27:43.651464 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:27:43.651464 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:27:43.651464 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:27:43.651464 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:27:43.651464 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:27:43.651464 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:27:43.651464 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:27:43.651464 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 752de513-d1ba-43b2-b68d-912134b1d215 could not be found. Jun 22 10:27:43.651464 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:27:43.651464 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:27:43.651464 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:27:43.651464 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:27:43.651464 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:27:43.651464 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:27:43.651464 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:27:43.651464 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:27:43.651464 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 752de513-d1ba-43b2-b68d-912134b1d215 could not be found. Jun 22 10:27:43.651464 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:27:43.653056 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-e0aab3a5-ecaf-40a7-9d65-94cda54eea57 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Returning 404 to user: Instance 752de513-d1ba-43b2-b68d-912134b1d215 could not be found. {{(pid=117680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:27:43.653056 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-e0aab3a5-ecaf-40a7-9d65-94cda54eea57 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/752de513-d1ba-43b2-b68d-912134b1d215" status: 404 len: 111 microversion: 2.1 time: 0.030803 Jun 22 10:27:43.653056 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 331/639] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:27:43 2022] GET /compute/v2.1/servers/752de513-d1ba-43b2-b68d-912134b1d215 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:27:43.658032 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-64ee1127-f216-4b38-a5e2-87e5921a39f0 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '.version_select at 0x7f60d98d1820>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:43.678780 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-64ee1127-f216-4b38-a5e2-87e5921a39f0 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1375683674" status: 202 len: 0 microversion: 2.1 time: 0.024884 Jun 22 10:27:43.679359 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 332/640] 10.222.0.66 () {58 vars in 1220 bytes} [Wed Jun 22 10:27:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1375683674 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 22 10:27:43.779955 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-4550e5db-63cd-4809-980d-6f685cf092fd tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a394fc62e6a64a85b855bf2eb56b4b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a87feacfb84d6c9f7ea48f230753b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:43.795298 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-4550e5db-63cd-4809-980d-6f685cf092fd tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "GET /compute/v2.1/servers/360c07f1-5b2e-41c9-a44e-d547784cf097" status: 200 len: 1452 microversion: 2.1 time: 0.251998 Jun 22 10:27:43.796228 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 309/641] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:27:43 2022] GET /compute/v2.1/servers/360c07f1-5b2e-41c9-a44e-d547784cf097 => generated 1452 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:27:44.787751 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-f88e3623-6ef8-4f21-a394-51e740c1f5d8 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:44.788379 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-f88e3623-6ef8-4f21-a394-51e740c1f5d8 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: c9505087-b458-46dc-9fbb-ee4ef61decde] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:44.795366 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f88e3623-6ef8-4f21-a394-51e740c1f5d8 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:44.795818 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f88e3623-6ef8-4f21-a394-51e740c1f5d8 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:44.796603 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f88e3623-6ef8-4f21-a394-51e740c1f5d8 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:44.797041 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f88e3623-6ef8-4f21-a394-51e740c1f5d8 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:44.881419 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.objects.instance [None req-f88e3623-6ef8-4f21-a394-51e740c1f5d8 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lazy-loading 'services' on Instance uuid c9505087-b458-46dc-9fbb-ee4ef61decde {{(pid=117680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:27:45.000381 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-f88e3623-6ef8-4f21-a394-51e740c1f5d8 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "DELETE /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde/os-volume_attachments/2ac05241-ea18-4902-9d40-ed08ff278b9e" status: 202 len: 0 microversion: 2.1 time: 0.216855 Jun 22 10:27:45.000926 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 333/642] 10.222.0.66 () {58 vars in 1415 bytes} [Wed Jun 22 10:27:44 2022] DELETE /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde/os-volume_attachments/2ac05241-ea18-4902-9d40-ed08ff278b9e => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:27:45.009457 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-21e896f0-356d-4d11-b04e-68532db5da23 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:45.011017 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-21e896f0-356d-4d11-b04e-68532db5da23 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: c9505087-b458-46dc-9fbb-ee4ef61decde] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:45.018709 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-21e896f0-356d-4d11-b04e-68532db5da23 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:45.019356 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-21e896f0-356d-4d11-b04e-68532db5da23 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:45.020460 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-21e896f0-356d-4d11-b04e-68532db5da23 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:45.021076 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-21e896f0-356d-4d11-b04e-68532db5da23 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:45.058338 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-21e896f0-356d-4d11-b04e-68532db5da23 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052937 Jun 22 10:27:45.062888 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 310/643] 10.222.0.66 () {58 vars in 1301 bytes} [Wed Jun 22 10:27:45 2022] GET /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:27:45.884562 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-378677fc-994f-4b8a-9618-154ab6a3415f req-9869ac2d-ccd8-4bb7-bc79-cfb808db7550 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "360c07f1-5b2e-41c9-a44e-d547784cf097", "tag": "2e43553e-4d3a-4e20-b17c-54a25459963b"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:27:45.888182 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:27:45.895045 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-378677fc-994f-4b8a-9618-154ab6a3415f req-9869ac2d-ccd8-4bb7-bc79-cfb808db7550 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:45.895427 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-378677fc-994f-4b8a-9618-154ab6a3415f req-9869ac2d-ccd8-4bb7-bc79-cfb808db7550 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:45.909702 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-378677fc-994f-4b8a-9618-154ab6a3415f req-9869ac2d-ccd8-4bb7-bc79-cfb808db7550 service nova] Creating event network-changed:2e43553e-4d3a-4e20-b17c-54a25459963b for instance 360c07f1-5b2e-41c9-a44e-d547784cf097 on hv-cinder-84713 Jun 22 10:27:45.915634 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-378677fc-994f-4b8a-9618-154ab6a3415f req-9869ac2d-ccd8-4bb7-bc79-cfb808db7550 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035603 Jun 22 10:27:45.916453 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 334/644] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:27:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:27:46.069893 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-32cb4bd7-48b5-4ce6-a160-aa742e0bf202 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:46.071208 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-32cb4bd7-48b5-4ce6-a160-aa742e0bf202 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: c9505087-b458-46dc-9fbb-ee4ef61decde] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:46.078376 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-32cb4bd7-48b5-4ce6-a160-aa742e0bf202 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:46.078991 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-32cb4bd7-48b5-4ce6-a160-aa742e0bf202 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:46.079877 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-32cb4bd7-48b5-4ce6-a160-aa742e0bf202 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:46.080412 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-32cb4bd7-48b5-4ce6-a160-aa742e0bf202 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:46.112144 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-32cb4bd7-48b5-4ce6-a160-aa742e0bf202 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046444 Jun 22 10:27:46.112729 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 311/645] 10.222.0.66 () {58 vars in 1301 bytes} [Wed Jun 22 10:27:46 2022] GET /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 22 10:27:46.179262 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-75fc77ae-d8b7-47c7-b674-7c1233687979 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:46.179956 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-75fc77ae-d8b7-47c7-b674-7c1233687979 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: c9505087-b458-46dc-9fbb-ee4ef61decde] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:46.188788 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-75fc77ae-d8b7-47c7-b674-7c1233687979 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:46.189328 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-75fc77ae-d8b7-47c7-b674-7c1233687979 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:46.190180 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-75fc77ae-d8b7-47c7-b674-7c1233687979 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:46.190712 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-75fc77ae-d8b7-47c7-b674-7c1233687979 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:46.218278 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-75fc77ae-d8b7-47c7-b674-7c1233687979 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: c9505087-b458-46dc-9fbb-ee4ef61decde] Going to try to terminate instance {{(pid=117680) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 10:27:46.305530 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-75fc77ae-d8b7-47c7-b674-7c1233687979 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "DELETE /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde" status: 204 len: 0 microversion: 2.1 time: 0.130065 Jun 22 10:27:46.309309 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 335/646] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Jun 22 10:27:46 2022] DELETE /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 10:27:46.315908 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-5549ff92-6302-46b0-84b3-15f91df78332 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:46.316655 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-5549ff92-6302-46b0-84b3-15f91df78332 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: c9505087-b458-46dc-9fbb-ee4ef61decde] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:46.322711 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:27:46.324606 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5549ff92-6302-46b0-84b3-15f91df78332 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:46.325355 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5549ff92-6302-46b0-84b3-15f91df78332 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:46.326311 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5549ff92-6302-46b0-84b3-15f91df78332 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:46.326916 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5549ff92-6302-46b0-84b3-15f91df78332 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:46.925558 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-5549ff92-6302-46b0-84b3-15f91df78332 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:46.934376 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-5549ff92-6302-46b0-84b3-15f91df78332 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde" status: 200 len: 1680 microversion: 2.1 time: 0.622809 Jun 22 10:27:46.934985 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 312/647] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:27:46 2022] GET /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde => generated 1680 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:27:47.953431 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-67e4e4e7-84eb-4d48-ac03-3c87eda14fc0 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:47.954228 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-67e4e4e7-84eb-4d48-ac03-3c87eda14fc0 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: c9505087-b458-46dc-9fbb-ee4ef61decde] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:47.961541 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-67e4e4e7-84eb-4d48-ac03-3c87eda14fc0 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:47.961987 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-67e4e4e7-84eb-4d48-ac03-3c87eda14fc0 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:47.962808 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-67e4e4e7-84eb-4d48-ac03-3c87eda14fc0 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:47.963243 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-67e4e4e7-84eb-4d48-ac03-3c87eda14fc0 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:48.036084 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-67e4e4e7-84eb-4d48-ac03-3c87eda14fc0 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:48.044049 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-67e4e4e7-84eb-4d48-ac03-3c87eda14fc0 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde" status: 200 len: 1613 microversion: 2.1 time: 0.095841 Jun 22 10:27:48.044869 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 336/648] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:27:47 2022] GET /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde => generated 1613 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:27:48.229910 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-c5620fe5-de38-4d0f-8840-9edafe1ef95c req-2d41545c-88b6-432f-b28a-4c1cce88b66a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9505087-b458-46dc-9fbb-ee4ef61decde", "name": "network-vif-deleted", "tag": "2527809f-dcc9-4a6b-88ec-69d974d132c2"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:27:48.254251 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-c5620fe5-de38-4d0f-8840-9edafe1ef95c req-2d41545c-88b6-432f-b28a-4c1cce88b66a service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:48.254827 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-c5620fe5-de38-4d0f-8840-9edafe1ef95c req-2d41545c-88b6-432f-b28a-4c1cce88b66a service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:48.269356 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-c5620fe5-de38-4d0f-8840-9edafe1ef95c req-2d41545c-88b6-432f-b28a-4c1cce88b66a service nova] Creating event network-vif-deleted:2527809f-dcc9-4a6b-88ec-69d974d132c2 for instance c9505087-b458-46dc-9fbb-ee4ef61decde on hv-cinder-84713 Jun 22 10:27:48.275834 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-c5620fe5-de38-4d0f-8840-9edafe1ef95c req-2d41545c-88b6-432f-b28a-4c1cce88b66a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051463 Jun 22 10:27:48.282989 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 313/649] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:27:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:27:49.061518 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-736b8435-0736-4504-a8c6-e928ab32b396 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:49.062127 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-736b8435-0736-4504-a8c6-e928ab32b396 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: c9505087-b458-46dc-9fbb-ee4ef61decde] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:49.069970 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-736b8435-0736-4504-a8c6-e928ab32b396 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:49.070426 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-736b8435-0736-4504-a8c6-e928ab32b396 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:49.071241 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-736b8435-0736-4504-a8c6-e928ab32b396 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:49.071695 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-736b8435-0736-4504-a8c6-e928ab32b396 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:49.086398 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.wsgi [None req-736b8435-0736-4504-a8c6-e928ab32b396 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] HTTP exception thrown: Instance c9505087-b458-46dc-9fbb-ee4ef61decde could not be found. Jun 22 10:27:49.088107 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-736b8435-0736-4504-a8c6-e928ab32b396 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Request method failure captured: Jun 22 10:27:49.088107 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: request: GET /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde HTTP/1.1 Jun 22 10:27:49.088107 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Accept: application/json Jun 22 10:27:49.088107 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Accept-Encoding: identity Jun 22 10:27:49.088107 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Connection: close Jun 22 10:27:49.088107 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Content-Length: 0 Jun 22 10:27:49.088107 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Content-Type: application/json Jun 22 10:27:49.088107 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Host: 10.222.0.66 Jun 22 10:27:49.088107 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Openstack-System-Scope: None Jun 22 10:27:49.088107 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: User-Agent: python-urllib3/1.26.9 Jun 22 10:27:49.088107 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Auth-Token: gAAAAABisu0Ck1QB2Lvyg9V3u3kBIuXEDJgkZ8XS4Rgzd5ukw0XPlYur1JC85E1WWEVd6k3S8eI6-t0Re7y4TmCuzTPaStOxInH_tNEfhxW9RG6_giYUrX4Dn5Ql7KnDFRmmntDTB2iztYRLelndnkJ5B_3DXuocSGsy72opKKw0vOKEx9YRw_Y Jun 22 10:27:49.088107 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Domain-Id: None Jun 22 10:27:49.088107 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Domain-Name: None Jun 22 10:27:49.088107 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Identity-Status: Confirmed Jun 22 10:27:49.088107 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Is-Admin-Project: True Jun 22 10:27:49.088107 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Domain-Id: default Jun 22 10:27:49.088107 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Domain-Name: Default Jun 22 10:27:49.088107 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Id: 1db3fe97f51f47a98da3cbc8f0d55741 Jun 22 10:27:49.088107 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Name: tempest-AttachVolumeNegativeTest-873283835 Jun 22 10:27:49.088107 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Role: member,reader Jun 22 10:27:49.088107 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Roles: member,reader Jun 22 10:27:49.089640 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_1db3fe97f51f47a98da3cbc8f0d55741"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1db3fe97f51f47a98da3cbc8f0d55741"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/1db3fe97f51f47a98da3cbc8f0d55741"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1db3fe97f51f47a98da3cbc8f0d55741"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}] Jun 22 10:27:49.089640 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant: tempest-AttachVolumeNegativeTest-873283835 Jun 22 10:27:49.089640 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant-Id: 1db3fe97f51f47a98da3cbc8f0d55741 Jun 22 10:27:49.089640 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-873283835 Jun 22 10:27:49.089640 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User: tempest-AttachVolumeNegativeTest-873283835-project Jun 22 10:27:49.089640 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Domain-Id: default Jun 22 10:27:49.089640 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Domain-Name: Default Jun 22 10:27:49.089640 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Id: da80b9a52feb462faf0469f2ab701fb8 Jun 22 10:27:49.089640 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Name: tempest-AttachVolumeNegativeTest-873283835-project Jun 22 10:27:49.089640 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: method: > Jun 22 10:27:49.089640 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: exception: Instance c9505087-b458-46dc-9fbb-ee4ef61decde could not be found. Jun 22 10:27:49.089640 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: action_args: {'id': 'c9505087-b458-46dc-9fbb-ee4ef61decde'} Jun 22 10:27:49.090464 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:27:49.090464 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:27:49.090464 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:27:49.090464 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:27:49.090464 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:27:49.090464 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:27:49.090464 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:27:49.090464 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:27:49.090464 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:27:49.090464 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:27:49.090464 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9505087-b458-46dc-9fbb-ee4ef61decde could not be found. Jun 22 10:27:49.090464 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:27:49.090464 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:27:49.090464 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:27:49.090464 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:27:49.090464 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:27:49.090464 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:27:49.090464 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:27:49.090464 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:27:49.090464 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:27:49.091950 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:27:49.091950 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:27:49.091950 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:27:49.091950 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:27:49.091950 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:27:49.091950 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:27:49.091950 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:27:49.091950 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9505087-b458-46dc-9fbb-ee4ef61decde could not be found. Jun 22 10:27:49.091950 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:27:49.091950 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:27:49.091950 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:27:49.091950 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:27:49.091950 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:27:49.091950 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:27:49.091950 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:27:49.091950 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:27:49.091950 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9505087-b458-46dc-9fbb-ee4ef61decde could not be found. Jun 22 10:27:49.091950 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:27:49.093293 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-736b8435-0736-4504-a8c6-e928ab32b396 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Returning 404 to user: Instance c9505087-b458-46dc-9fbb-ee4ef61decde could not be found. {{(pid=117680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:27:49.093293 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-736b8435-0736-4504-a8c6-e928ab32b396 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde" status: 404 len: 111 microversion: 2.1 time: 0.032065 Jun 22 10:27:49.093653 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 337/650] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:27:49 2022] GET /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:27:49.099749 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-f44ec8a9-c1bb-4c51-b516-76a6d1dbaf70 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '.version_select at 0x7f60da07e940>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:49.127662 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-f44ec8a9-c1bb-4c51-b516-76a6d1dbaf70 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-687818091" status: 202 len: 0 microversion: 2.1 time: 0.032496 Jun 22 10:27:49.134460 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 314/651] 10.222.0.66 () {58 vars in 1217 bytes} [Wed Jun 22 10:27:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-687818091 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:27:49.455000 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-e0896f43-b80f-4170-be80-6446727484a6 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:49.455810 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-e0896f43-b80f-4170-be80-6446727484a6 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:49.462582 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e0896f43-b80f-4170-be80-6446727484a6 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:49.463047 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e0896f43-b80f-4170-be80-6446727484a6 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:49.463834 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e0896f43-b80f-4170-be80-6446727484a6 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:49.464271 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e0896f43-b80f-4170-be80-6446727484a6 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:49.497708 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-e0896f43-b80f-4170-be80-6446727484a6 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d/os-volume_attachments/486bb536-1840-459d-a4a9-4d5733c634b5" status: 200 len: 194 microversion: 2.20 time: 0.047007 Jun 22 10:27:49.498647 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 338/652] 10.222.0.66 () {60 vars in 1453 bytes} [Wed Jun 22 10:27:49 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d/os-volume_attachments/486bb536-1840-459d-a4a9-4d5733c634b5 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 10:27:49.568501 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-0097bedc-befe-4615-8869-057026f49223 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:49.569109 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-0097bedc-befe-4615-8869-057026f49223 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:49.575823 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0097bedc-befe-4615-8869-057026f49223 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:49.576275 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0097bedc-befe-4615-8869-057026f49223 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:49.577062 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0097bedc-befe-4615-8869-057026f49223 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:49.577507 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0097bedc-befe-4615-8869-057026f49223 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:49.670621 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.objects.instance [None req-0097bedc-befe-4615-8869-057026f49223 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lazy-loading 'services' on Instance uuid 755c0b10-e04a-42fa-86da-8cc65537315d {{(pid=117679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:27:49.754605 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-0097bedc-befe-4615-8869-057026f49223 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "DELETE /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d/os-volume_attachments/486bb536-1840-459d-a4a9-4d5733c634b5" status: 202 len: 0 microversion: 2.20 time: 0.190609 Jun 22 10:27:49.755484 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 315/653] 10.222.0.66 () {60 vars in 1456 bytes} [Wed Jun 22 10:27:49 2022] DELETE /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d/os-volume_attachments/486bb536-1840-459d-a4a9-4d5733c634b5 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 22 10:27:49.763897 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-341d86d4-0d3d-4b11-b5c1-a358be095c12 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:49.764845 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-341d86d4-0d3d-4b11-b5c1-a358be095c12 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:49.771306 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-341d86d4-0d3d-4b11-b5c1-a358be095c12 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:49.771767 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-341d86d4-0d3d-4b11-b5c1-a358be095c12 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:49.772555 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-341d86d4-0d3d-4b11-b5c1-a358be095c12 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:49.772998 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-341d86d4-0d3d-4b11-b5c1-a358be095c12 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:49.801122 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:27:49.808303 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-341d86d4-0d3d-4b11-b5c1-a358be095c12 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048432 Jun 22 10:27:49.809100 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 339/654] 10.222.0.66 () {60 vars in 1342 bytes} [Wed Jun 22 10:27:49 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 22 10:27:49.818716 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-606bdb7c-dd02-4d5e-afbd-d668f16e162b tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Action: 'create', calling method: .version_select at 0x7f60d9fd7430>, body: {"keypair": {"name": "tempest-keypair-508853585", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE8QA1ryD2MfvbahfPn/5i4f6w0xWLC2UDDpkKoY8iQ8hM7c3D6EHKuS8Adc+o6AehI4zBd+ZcMNg77kpJ7EnBqNavf61UYTJo6tXLoE0949A9FcLKwkW+9xIbAKeXe82Q=="}} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:27:49.835539 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.quota [None req-606bdb7c-dd02-4d5e-afbd-d668f16e162b tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Getting quotas for project 1db3fe97f51f47a98da3cbc8f0d55741. Resources: {'key_pairs'} {{(pid=117679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:27:49.840360 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.quota [None req-606bdb7c-dd02-4d5e-afbd-d668f16e162b tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Getting quotas for user da80b9a52feb462faf0469f2ab701fb8 and project 1db3fe97f51f47a98da3cbc8f0d55741. Resources: {'key_pairs'} {{(pid=117679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:27:49.868633 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-606bdb7c-dd02-4d5e-afbd-d668f16e162b tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.054569 Jun 22 10:27:49.869246 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 316/655] 10.222.0.66 () {60 vars in 1158 bytes} [Wed Jun 22 10:27:49 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:27:50.820983 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-24edcb87-1ce5-4263-965d-b5e2d6dc6b42 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:50.821857 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-24edcb87-1ce5-4263-965d-b5e2d6dc6b42 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:50.832838 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-24edcb87-1ce5-4263-965d-b5e2d6dc6b42 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:50.832838 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-24edcb87-1ce5-4263-965d-b5e2d6dc6b42 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:50.832838 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-24edcb87-1ce5-4263-965d-b5e2d6dc6b42 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:50.832838 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-24edcb87-1ce5-4263-965d-b5e2d6dc6b42 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:50.864005 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-24edcb87-1ce5-4263-965d-b5e2d6dc6b42 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047320 Jun 22 10:27:50.864579 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 340/656] 10.222.0.66 () {60 vars in 1342 bytes} [Wed Jun 22 10:27:50 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:27:51.085336 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-7f018436-9bee-4b06-9028-34eea421f187 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:51.086038 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-7f018436-9bee-4b06-9028-34eea421f187 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:51.092520 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7f018436-9bee-4b06-9028-34eea421f187 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:51.093031 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7f018436-9bee-4b06-9028-34eea421f187 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:51.093870 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7f018436-9bee-4b06-9028-34eea421f187 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:51.094371 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7f018436-9bee-4b06-9028-34eea421f187 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:51.121469 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-7f018436-9bee-4b06-9028-34eea421f187 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Going to try to terminate instance {{(pid=117679) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 10:27:51.202868 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-7f018436-9bee-4b06-9028-34eea421f187 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "DELETE /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 204 len: 0 microversion: 2.20 time: 0.121779 Jun 22 10:27:51.203458 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 317/657] 10.222.0.66 () {60 vars in 1279 bytes} [Wed Jun 22 10:27:51 2022] DELETE /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 22 10:27:51.211845 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-e2c1a91e-40c2-4f61-8e5d-f4c05bb87e52 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:51.212456 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-e2c1a91e-40c2-4f61-8e5d-f4c05bb87e52 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:51.218807 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e2c1a91e-40c2-4f61-8e5d-f4c05bb87e52 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:51.219259 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e2c1a91e-40c2-4f61-8e5d-f4c05bb87e52 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:51.220034 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e2c1a91e-40c2-4f61-8e5d-f4c05bb87e52 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:51.220476 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e2c1a91e-40c2-4f61-8e5d-f4c05bb87e52 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:51.233491 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-86b286fd-06a4-4a90-b254-a3154e08c18a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-580018302", "imageRef": "58addf50-5317-403a-beb0-4760bdbcaa13", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "09887ec6-fdf3-4f5d-9b2b-0fe6b3011cfb"}], "security_groups": [{"name": "tempest-securitygroup--1828790039"}], "key_name": "tempest-keypair-508853585", "user_data": "}} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:27:51.372745 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.network.neutron [None req-86b286fd-06a4-4a90-b254-a3154e08c18a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] validate_networks() for [('09887ec6-fdf3-4f5d-9b2b-0fe6b3011cfb', None, None, None, None, None)] {{(pid=117679) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 10:27:51.378759 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-e2c1a91e-40c2-4f61-8e5d-f4c05bb87e52 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:51.388004 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-e2c1a91e-40c2-4f61-8e5d-f4c05bb87e52 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:51.389078 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-e2c1a91e-40c2-4f61-8e5d-f4c05bb87e52 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:51.390167 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-e2c1a91e-40c2-4f61-8e5d-f4c05bb87e52 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1724 microversion: 2.20 time: 0.182282 Jun 22 10:27:51.392265 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 341/658] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:27:51 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:27:51.751036 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-86b286fd-06a4-4a90-b254-a3154e08c18a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Flavor limits 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 10:27:51.751606 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-86b286fd-06a4-4a90-b254-a3154e08c18a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Image limits 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 10:27:51.752273 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-86b286fd-06a4-4a90-b254-a3154e08c18a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Flavor pref 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 10:27:51.752779 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-86b286fd-06a4-4a90-b254-a3154e08c18a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Image pref 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 10:27:51.753355 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-86b286fd-06a4-4a90-b254-a3154e08c18a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 10:27:51.766248 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-86b286fd-06a4-4a90-b254-a3154e08c18a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:51.766812 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-86b286fd-06a4-4a90-b254-a3154e08c18a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:51.767984 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-86b286fd-06a4-4a90-b254-a3154e08c18a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:51.768426 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-86b286fd-06a4-4a90-b254-a3154e08c18a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:51.786694 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.quota [None req-86b286fd-06a4-4a90-b254-a3154e08c18a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Getting quotas for project 1db3fe97f51f47a98da3cbc8f0d55741. Resources: {'instances', 'cores', 'ram'} {{(pid=117679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:27:51.790931 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.quota [None req-86b286fd-06a4-4a90-b254-a3154e08c18a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Getting quotas for user da80b9a52feb462faf0469f2ab701fb8 and project 1db3fe97f51f47a98da3cbc8f0d55741. Resources: {'instances', 'cores', 'ram'} {{(pid=117679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:27:51.802570 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-86b286fd-06a4-4a90-b254-a3154e08c18a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Going to run 1 instances... {{(pid=117679) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 10:27:51.805074 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-86b286fd-06a4-4a90-b254-a3154e08c18a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: d02a6b26-3c65-44a5-8c06-88f9e38f30c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58addf50-5317-403a-beb0-4760bdbcaa13',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 10:27:51.853890 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-86b286fd-06a4-4a90-b254-a3154e08c18a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.624874 Jun 22 10:27:51.854425 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 318/659] 10.222.0.66 () {60 vars in 1146 bytes} [Wed Jun 22 10:27:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 22 10:27:51.866386 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-08ef3296-c192-4d44-beef-7b924541ef43 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:51.867021 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-08ef3296-c192-4d44-beef-7b924541ef43 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: d02a6b26-3c65-44a5-8c06-88f9e38f30c7] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:51.927629 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-08ef3296-c192-4d44-beef-7b924541ef43 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:51.934581 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-08ef3296-c192-4d44-beef-7b924541ef43 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/d02a6b26-3c65-44a5-8c06-88f9e38f30c7" status: 200 len: 1240 microversion: 2.1 time: 0.072357 Jun 22 10:27:51.935159 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 342/660] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:27:51 2022] GET /compute/v2.1/servers/d02a6b26-3c65-44a5-8c06-88f9e38f30c7 => generated 1240 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:27:52.411910 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-5a1b57d5-a61e-49cf-baa0-08254edba91d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:52.412528 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-5a1b57d5-a61e-49cf-baa0-08254edba91d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:52.420756 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5a1b57d5-a61e-49cf-baa0-08254edba91d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:52.421219 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5a1b57d5-a61e-49cf-baa0-08254edba91d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:52.422090 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5a1b57d5-a61e-49cf-baa0-08254edba91d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:52.422582 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5a1b57d5-a61e-49cf-baa0-08254edba91d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:52.572192 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-5a1b57d5-a61e-49cf-baa0-08254edba91d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:52.584176 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-5a1b57d5-a61e-49cf-baa0-08254edba91d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:52.585724 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-5a1b57d5-a61e-49cf-baa0-08254edba91d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:52.586923 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-5a1b57d5-a61e-49cf-baa0-08254edba91d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1724 microversion: 2.20 time: 0.179601 Jun 22 10:27:52.587485 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 319/661] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:27:52 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:27:52.955073 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-7ac1bd38-a8e8-4e97-a781-231bec9cfed6 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:52.956028 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-7ac1bd38-a8e8-4e97-a781-231bec9cfed6 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: d02a6b26-3c65-44a5-8c06-88f9e38f30c7] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:52.966265 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7ac1bd38-a8e8-4e97-a781-231bec9cfed6 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:52.966740 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7ac1bd38-a8e8-4e97-a781-231bec9cfed6 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:52.967513 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7ac1bd38-a8e8-4e97-a781-231bec9cfed6 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:52.967948 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7ac1bd38-a8e8-4e97-a781-231bec9cfed6 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:53.035960 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-7ac1bd38-a8e8-4e97-a781-231bec9cfed6 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:53.045289 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-7ac1bd38-a8e8-4e97-a781-231bec9cfed6 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/d02a6b26-3c65-44a5-8c06-88f9e38f30c7" status: 200 len: 1292 microversion: 2.1 time: 0.096382 Jun 22 10:27:53.045911 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 343/662] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:27:52 2022] GET /compute/v2.1/servers/d02a6b26-3c65-44a5-8c06-88f9e38f30c7 => generated 1292 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:27:53.608580 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-abafbc09-d0a2-4cbc-9f47-2f5c43d1de0b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:53.609351 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-abafbc09-d0a2-4cbc-9f47-2f5c43d1de0b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:53.620107 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-abafbc09-d0a2-4cbc-9f47-2f5c43d1de0b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:53.620565 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-abafbc09-d0a2-4cbc-9f47-2f5c43d1de0b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:53.621441 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-abafbc09-d0a2-4cbc-9f47-2f5c43d1de0b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:53.621882 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-abafbc09-d0a2-4cbc-9f47-2f5c43d1de0b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:53.644694 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:27:53.818453 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-abafbc09-d0a2-4cbc-9f47-2f5c43d1de0b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:53.827667 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-abafbc09-d0a2-4cbc-9f47-2f5c43d1de0b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:53.830370 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-abafbc09-d0a2-4cbc-9f47-2f5c43d1de0b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:53.830973 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-abafbc09-d0a2-4cbc-9f47-2f5c43d1de0b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1724 microversion: 2.20 time: 0.227967 Jun 22 10:27:53.839458 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 320/663] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:27:53 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1724 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:27:54.067812 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-acebe2ff-55c9-45f7-9dff-1ab1c55083c3 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:54.069265 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-acebe2ff-55c9-45f7-9dff-1ab1c55083c3 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: d02a6b26-3c65-44a5-8c06-88f9e38f30c7] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:54.081251 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-acebe2ff-55c9-45f7-9dff-1ab1c55083c3 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:54.082303 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-acebe2ff-55c9-45f7-9dff-1ab1c55083c3 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:54.084112 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-acebe2ff-55c9-45f7-9dff-1ab1c55083c3 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:54.085004 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-acebe2ff-55c9-45f7-9dff-1ab1c55083c3 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:54.191774 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-acebe2ff-55c9-45f7-9dff-1ab1c55083c3 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:54.203704 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-acebe2ff-55c9-45f7-9dff-1ab1c55083c3 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/d02a6b26-3c65-44a5-8c06-88f9e38f30c7" status: 200 len: 1298 microversion: 2.1 time: 0.143246 Jun 22 10:27:54.220061 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 344/664] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:27:54 2022] GET /compute/v2.1/servers/d02a6b26-3c65-44a5-8c06-88f9e38f30c7 => generated 1298 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:27:54.534713 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-1d5c5c29-4287-4b6c-b227-481ea062cbaa req-6c74f272-1a4a-4a37-8adc-40bd1ca8e4c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "755c0b10-e04a-42fa-86da-8cc65537315d", "name": "network-vif-deleted", "tag": "2931da67-7e8b-43c4-9fbb-3adba1b7225a"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:27:54.544063 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-1d5c5c29-4287-4b6c-b227-481ea062cbaa req-6c74f272-1a4a-4a37-8adc-40bd1ca8e4c2 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:54.545184 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-1d5c5c29-4287-4b6c-b227-481ea062cbaa req-6c74f272-1a4a-4a37-8adc-40bd1ca8e4c2 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:54.578605 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-1d5c5c29-4287-4b6c-b227-481ea062cbaa req-6c74f272-1a4a-4a37-8adc-40bd1ca8e4c2 service nova] Creating event network-vif-deleted:2931da67-7e8b-43c4-9fbb-3adba1b7225a for instance 755c0b10-e04a-42fa-86da-8cc65537315d on hv-cinder-84713 Jun 22 10:27:54.585281 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-1d5c5c29-4287-4b6c-b227-481ea062cbaa req-6c74f272-1a4a-4a37-8adc-40bd1ca8e4c2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053765 Jun 22 10:27:54.586997 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 321/665] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:27:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:27:54.854213 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-933824d5-d493-4d0c-a3f2-e1a131e36ddc tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:54.855578 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-933824d5-d493-4d0c-a3f2-e1a131e36ddc tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:54.866551 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-933824d5-d493-4d0c-a3f2-e1a131e36ddc tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:54.867508 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-933824d5-d493-4d0c-a3f2-e1a131e36ddc tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:54.869050 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-933824d5-d493-4d0c-a3f2-e1a131e36ddc tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:54.869986 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-933824d5-d493-4d0c-a3f2-e1a131e36ddc tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:54.930799 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-933824d5-d493-4d0c-a3f2-e1a131e36ddc tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:54.931763 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-933824d5-d493-4d0c-a3f2-e1a131e36ddc tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:54.932808 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.objects.instance [None req-933824d5-d493-4d0c-a3f2-e1a131e36ddc tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lazy-loading 'fault' on Instance uuid 755c0b10-e04a-42fa-86da-8cc65537315d {{(pid=117680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:27:55.004107 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-933824d5-d493-4d0c-a3f2-e1a131e36ddc tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:55.016722 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-933824d5-d493-4d0c-a3f2-e1a131e36ddc tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:55.019498 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-933824d5-d493-4d0c-a3f2-e1a131e36ddc tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:55.021882 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-933824d5-d493-4d0c-a3f2-e1a131e36ddc tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 200 len: 1372 microversion: 2.20 time: 0.175157 Jun 22 10:27:55.024895 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 345/666] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:27:54 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 1372 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:27:55.241174 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-36428cc3-5b27-4d0b-8ccd-a5e0a0f0855b tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:55.243902 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-36428cc3-5b27-4d0b-8ccd-a5e0a0f0855b tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: d02a6b26-3c65-44a5-8c06-88f9e38f30c7] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:55.271702 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-36428cc3-5b27-4d0b-8ccd-a5e0a0f0855b tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:55.273094 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-36428cc3-5b27-4d0b-8ccd-a5e0a0f0855b tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:55.274889 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-36428cc3-5b27-4d0b-8ccd-a5e0a0f0855b tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:55.276711 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-36428cc3-5b27-4d0b-8ccd-a5e0a0f0855b tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:55.405169 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-69185361-2c19-42ee-84fb-30dc2ac28db0 req-2d4fb78e-9a59-4145-8362-9e326ab3aef0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d02a6b26-3c65-44a5-8c06-88f9e38f30c7", "tag": "8133c601-129a-4ea3-a1d7-c165a1a07276"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:27:55.429471 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-69185361-2c19-42ee-84fb-30dc2ac28db0 req-2d4fb78e-9a59-4145-8362-9e326ab3aef0 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:55.430372 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-69185361-2c19-42ee-84fb-30dc2ac28db0 req-2d4fb78e-9a59-4145-8362-9e326ab3aef0 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:55.461162 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-69185361-2c19-42ee-84fb-30dc2ac28db0 req-2d4fb78e-9a59-4145-8362-9e326ab3aef0 service nova] Creating event network-changed:8133c601-129a-4ea3-a1d7-c165a1a07276 for instance d02a6b26-3c65-44a5-8c06-88f9e38f30c7 on hv-cinder-84713 Jun 22 10:27:55.467541 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-69185361-2c19-42ee-84fb-30dc2ac28db0 req-2d4fb78e-9a59-4145-8362-9e326ab3aef0 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083385 Jun 22 10:27:55.468172 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 346/667] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:27:55.679481 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-36428cc3-5b27-4d0b-8ccd-a5e0a0f0855b tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:55.690401 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-36428cc3-5b27-4d0b-8ccd-a5e0a0f0855b tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/d02a6b26-3c65-44a5-8c06-88f9e38f30c7" status: 200 len: 1366 microversion: 2.1 time: 0.466266 Jun 22 10:27:55.691607 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 322/668] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:27:55 2022] GET /compute/v2.1/servers/d02a6b26-3c65-44a5-8c06-88f9e38f30c7 => generated 1366 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:27:56.050258 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-dc24840b-631c-4e1c-9210-cd5e83516901 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:56.051005 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-dc24840b-631c-4e1c-9210-cd5e83516901 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:56.058398 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-dc24840b-631c-4e1c-9210-cd5e83516901 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:56.058861 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-dc24840b-631c-4e1c-9210-cd5e83516901 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:56.059656 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-dc24840b-631c-4e1c-9210-cd5e83516901 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:56.060096 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-dc24840b-631c-4e1c-9210-cd5e83516901 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:56.075470 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.wsgi [None req-dc24840b-631c-4e1c-9210-cd5e83516901 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] HTTP exception thrown: Instance 755c0b10-e04a-42fa-86da-8cc65537315d could not be found. Jun 22 10:27:56.077251 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-dc24840b-631c-4e1c-9210-cd5e83516901 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Request method failure captured: Jun 22 10:27:56.077251 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: request: GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d HTTP/1.1 Jun 22 10:27:56.077251 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Accept: application/json Jun 22 10:27:56.077251 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Accept-Encoding: identity Jun 22 10:27:56.077251 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Connection: close Jun 22 10:27:56.077251 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Content-Length: 0 Jun 22 10:27:56.077251 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Content-Type: application/json Jun 22 10:27:56.077251 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Host: 10.222.0.66 Jun 22 10:27:56.077251 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Openstack-System-Scope: None Jun 22 10:27:56.077251 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: User-Agent: python-urllib3/1.26.9 Jun 22 10:27:56.077251 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Auth-Token: gAAAAABisuz90HkkEoUENfUChd6TmiQkAaIahUh0f1LcrVqF9X9TYzDu-_8w9AeJx8tQPD_-2wiFtyOESrqQJDGS8IsjYKcEcS029h6kHDvLm7osBnYwjRswPp4Qz-wy5Hc6lH8TPM_-J_go3iGsotRWd6UVGBE6G5HptHl0g9QD6RvYDslBJ8k Jun 22 10:27:56.077251 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Domain-Id: None Jun 22 10:27:56.077251 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Domain-Name: None Jun 22 10:27:56.077251 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Identity-Status: Confirmed Jun 22 10:27:56.077251 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Is-Admin-Project: True Jun 22 10:27:56.077251 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Openstack-Nova-Api-Version: 2.20 Jun 22 10:27:56.077251 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Domain-Id: default Jun 22 10:27:56.077251 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Domain-Name: Default Jun 22 10:27:56.077251 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Id: 5d4c799515b04fff924caa9819be4faf Jun 22 10:27:56.077251 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-414805869 Jun 22 10:27:56.077251 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Role: member,reader Jun 22 10:27:56.077251 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Roles: member,reader Jun 22 10:27:56.079726 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_5d4c799515b04fff924caa9819be4faf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5d4c799515b04fff924caa9819be4faf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/5d4c799515b04fff924caa9819be4faf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5d4c799515b04fff924caa9819be4faf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}] Jun 22 10:27:56.079726 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant: tempest-AttachVolumeShelveTestJSON-414805869 Jun 22 10:27:56.079726 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant-Id: 5d4c799515b04fff924caa9819be4faf Jun 22 10:27:56.079726 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-414805869 Jun 22 10:27:56.079726 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User: tempest-AttachVolumeShelveTestJSON-414805869-project Jun 22 10:27:56.079726 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Domain-Id: default Jun 22 10:27:56.079726 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Domain-Name: Default Jun 22 10:27:56.079726 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Id: 60dbe36087e14f9e8bf885977b0e7426 Jun 22 10:27:56.079726 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Name: tempest-AttachVolumeShelveTestJSON-414805869-project Jun 22 10:27:56.079726 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: method: > Jun 22 10:27:56.079726 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: exception: Instance 755c0b10-e04a-42fa-86da-8cc65537315d could not be found. Jun 22 10:27:56.079726 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: action_args: {'id': '755c0b10-e04a-42fa-86da-8cc65537315d'} Jun 22 10:27:56.080607 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:27:56.080607 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:27:56.080607 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:27:56.080607 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:27:56.080607 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:27:56.080607 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:27:56.080607 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:27:56.080607 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:27:56.080607 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:27:56.080607 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:27:56.080607 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 755c0b10-e04a-42fa-86da-8cc65537315d could not be found. Jun 22 10:27:56.080607 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:27:56.080607 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:27:56.080607 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:27:56.080607 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:27:56.080607 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:27:56.080607 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:27:56.080607 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:27:56.080607 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:27:56.080607 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:27:56.082012 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:27:56.082012 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:27:56.082012 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:27:56.082012 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:27:56.082012 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:27:56.082012 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:27:56.082012 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:27:56.082012 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 755c0b10-e04a-42fa-86da-8cc65537315d could not be found. Jun 22 10:27:56.082012 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:27:56.082012 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:27:56.082012 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:27:56.082012 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:27:56.082012 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:27:56.082012 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:27:56.082012 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:27:56.082012 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:27:56.082012 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 755c0b10-e04a-42fa-86da-8cc65537315d could not be found. Jun 22 10:27:56.082012 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:27:56.083988 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-dc24840b-631c-4e1c-9210-cd5e83516901 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Returning 404 to user: Instance 755c0b10-e04a-42fa-86da-8cc65537315d could not be found. {{(pid=117680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:27:56.083988 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-dc24840b-631c-4e1c-9210-cd5e83516901 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 404 len: 111 microversion: 2.20 time: 0.032941 Jun 22 10:27:56.083988 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 347/669] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:27:56 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 22 10:27:56.088800 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-3e2fe116-2d2a-43f3-b83d-9981147b0e42 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '.version_select at 0x7f60d9f433a0>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:56.111487 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-3e2fe116-2d2a-43f3-b83d-9981147b0e42 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2113087024" status: 204 len: 0 microversion: 2.20 time: 0.026570 Jun 22 10:27:56.112917 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 323/670] 10.222.0.66 () {60 vars in 1261 bytes} [Wed Jun 22 10:27:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2113087024 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 22 10:27:56.708818 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-d8d7ed1f-0ed1-4c29-b6da-c980e5e18d11 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:56.709368 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-d8d7ed1f-0ed1-4c29-b6da-c980e5e18d11 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: d02a6b26-3c65-44a5-8c06-88f9e38f30c7] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:56.716075 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d8d7ed1f-0ed1-4c29-b6da-c980e5e18d11 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:56.716530 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d8d7ed1f-0ed1-4c29-b6da-c980e5e18d11 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:56.717304 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d8d7ed1f-0ed1-4c29-b6da-c980e5e18d11 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:56.717762 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d8d7ed1f-0ed1-4c29-b6da-c980e5e18d11 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:56.865561 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-d8d7ed1f-0ed1-4c29-b6da-c980e5e18d11 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:56.876325 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-d8d7ed1f-0ed1-4c29-b6da-c980e5e18d11 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/d02a6b26-3c65-44a5-8c06-88f9e38f30c7" status: 200 len: 1366 microversion: 2.1 time: 0.171580 Jun 22 10:27:56.886113 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 348/671] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:27:56 2022] GET /compute/v2.1/servers/d02a6b26-3c65-44a5-8c06-88f9e38f30c7 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:27:56.892608 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-4880dce4-3a14-4d6f-85c5-3b929246ac31 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Action: 'create', calling method: .version_select at 0x7f60d9fd7040>, body: {"keypair": {"name": "tempest-keypair-1330518368", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLXj40sTrpY4vh8Ju4zdhZWaHzAwMhA19Vd63KL3Q6MV51uJ564HVHrIgzy3riszTeBkWj9RR4H/P1T2V5vg7i+2BOYcW3THZdmd+7DBrjTbnavFUEgigK9IWgY0/yhEBQ=="}} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:27:56.908033 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.quota [None req-4880dce4-3a14-4d6f-85c5-3b929246ac31 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Getting quotas for project 5d4c799515b04fff924caa9819be4faf. Resources: {'key_pairs'} {{(pid=117679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:27:56.912248 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.quota [None req-4880dce4-3a14-4d6f-85c5-3b929246ac31 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Getting quotas for user 60dbe36087e14f9e8bf885977b0e7426 and project 5d4c799515b04fff924caa9819be4faf. Resources: {'key_pairs'} {{(pid=117679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:27:56.935330 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-4880dce4-3a14-4d6f-85c5-3b929246ac31 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.047466 Jun 22 10:27:56.935961 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 324/672] 10.222.0.66 () {62 vars in 1199 bytes} [Wed Jun 22 10:27:56 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 49 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 22 10:27:57.897516 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-16c6047f-e635-4072-8e97-e66fb0cc9953 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:57.898129 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-16c6047f-e635-4072-8e97-e66fb0cc9953 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: d02a6b26-3c65-44a5-8c06-88f9e38f30c7] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:57.905695 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-16c6047f-e635-4072-8e97-e66fb0cc9953 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:57.906146 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-16c6047f-e635-4072-8e97-e66fb0cc9953 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:57.906950 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-16c6047f-e635-4072-8e97-e66fb0cc9953 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:57.907383 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-16c6047f-e635-4072-8e97-e66fb0cc9953 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:58.144279 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-16c6047f-e635-4072-8e97-e66fb0cc9953 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:58.158771 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-16c6047f-e635-4072-8e97-e66fb0cc9953 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/d02a6b26-3c65-44a5-8c06-88f9e38f30c7" status: 200 len: 1366 microversion: 2.1 time: 0.264753 Jun 22 10:27:58.159834 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 349/673] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:27:57 2022] GET /compute/v2.1/servers/d02a6b26-3c65-44a5-8c06-88f9e38f30c7 => generated 1366 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:27:58.366395 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-09ad5975-cfee-4033-ba48-c36a0f984678 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-525787181", "imageRef": "58addf50-5317-403a-beb0-4760bdbcaa13", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "23bcbab7-3391-489e-8f1d-2df2c9649acc"}], "security_groups": [{"name": "tempest-securitygroup--1466907940"}], "key_name": "tempest-keypair-1330518368", "user_data": "}} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:27:58.473770 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.network.neutron [None req-09ad5975-cfee-4033-ba48-c36a0f984678 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] validate_networks() for [('23bcbab7-3391-489e-8f1d-2df2c9649acc', None, None, None, None, None)] {{(pid=117679) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 10:27:59.177083 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-4eb6a40c-26dc-4728-93a0-85a43efd9c03 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:59.177951 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-4eb6a40c-26dc-4728-93a0-85a43efd9c03 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: d02a6b26-3c65-44a5-8c06-88f9e38f30c7] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:59.185124 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4eb6a40c-26dc-4728-93a0-85a43efd9c03 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:59.185124 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4eb6a40c-26dc-4728-93a0-85a43efd9c03 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:59.186288 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4eb6a40c-26dc-4728-93a0-85a43efd9c03 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:59.186884 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4eb6a40c-26dc-4728-93a0-85a43efd9c03 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:59.225172 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-09ad5975-cfee-4033-ba48-c36a0f984678 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Flavor limits 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 10:27:59.225726 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-09ad5975-cfee-4033-ba48-c36a0f984678 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Image limits 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 10:27:59.226253 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-09ad5975-cfee-4033-ba48-c36a0f984678 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Flavor pref 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 10:27:59.226881 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-09ad5975-cfee-4033-ba48-c36a0f984678 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Image pref 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 10:27:59.227582 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-09ad5975-cfee-4033-ba48-c36a0f984678 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 10:27:59.246434 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-09ad5975-cfee-4033-ba48-c36a0f984678 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:59.246949 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-09ad5975-cfee-4033-ba48-c36a0f984678 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:59.247835 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-09ad5975-cfee-4033-ba48-c36a0f984678 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:27:59.248263 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-09ad5975-cfee-4033-ba48-c36a0f984678 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:27:59.266430 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.quota [None req-09ad5975-cfee-4033-ba48-c36a0f984678 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Getting quotas for project 5d4c799515b04fff924caa9819be4faf. Resources: {'instances', 'cores', 'ram'} {{(pid=117679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:27:59.271001 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.quota [None req-09ad5975-cfee-4033-ba48-c36a0f984678 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Getting quotas for user 60dbe36087e14f9e8bf885977b0e7426 and project 5d4c799515b04fff924caa9819be4faf. Resources: {'instances', 'cores', 'ram'} {{(pid=117679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:27:59.283222 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-09ad5975-cfee-4033-ba48-c36a0f984678 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Going to run 1 instances... {{(pid=117679) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 10:27:59.285497 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-09ad5975-cfee-4033-ba48-c36a0f984678 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58addf50-5317-403a-beb0-4760bdbcaa13',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 10:27:59.337947 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-09ad5975-cfee-4033-ba48-c36a0f984678 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.976710 Jun 22 10:27:59.338941 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 325/674] 10.222.0.66 () {62 vars in 1187 bytes} [Wed Jun 22 10:27:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 978 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 22 10:27:59.349598 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-f8be8c64-b7a2-445e-908b-8dcbe6ffb4aa tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:27:59.350309 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-f8be8c64-b7a2-445e-908b-8dcbe6ffb4aa tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:27:59.449005 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-4eb6a40c-26dc-4728-93a0-85a43efd9c03 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:59.454021 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-f8be8c64-b7a2-445e-908b-8dcbe6ffb4aa tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:59.457958 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-4eb6a40c-26dc-4728-93a0-85a43efd9c03 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/d02a6b26-3c65-44a5-8c06-88f9e38f30c7" status: 200 len: 1366 microversion: 2.1 time: 0.285192 Jun 22 10:27:59.459177 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 350/675] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:27:59 2022] GET /compute/v2.1/servers/d02a6b26-3c65-44a5-8c06-88f9e38f30c7 => generated 1366 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:27:59.463789 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-f8be8c64-b7a2-445e-908b-8dcbe6ffb4aa tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:59.465386 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-f8be8c64-b7a2-445e-908b-8dcbe6ffb4aa tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:27:59.466690 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-f8be8c64-b7a2-445e-908b-8dcbe6ffb4aa tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1281 microversion: 2.20 time: 0.121420 Jun 22 10:27:59.467766 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 326/676] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:27:59 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1281 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:28:00.478773 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-ce556ee2-84ce-47f3-bcc9-ba93e87c0269 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:00.480089 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-ce556ee2-84ce-47f3-bcc9-ba93e87c0269 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: d02a6b26-3c65-44a5-8c06-88f9e38f30c7] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:00.488532 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-b75392f9-ba0c-4ac9-bb59-61eccf2cb9f6 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:00.489611 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-b75392f9-ba0c-4ac9-bb59-61eccf2cb9f6 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:00.491665 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ce556ee2-84ce-47f3-bcc9-ba93e87c0269 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:00.492528 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ce556ee2-84ce-47f3-bcc9-ba93e87c0269 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:00.493909 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ce556ee2-84ce-47f3-bcc9-ba93e87c0269 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:00.494793 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ce556ee2-84ce-47f3-bcc9-ba93e87c0269 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:00.501104 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b75392f9-ba0c-4ac9-bb59-61eccf2cb9f6 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:00.502064 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b75392f9-ba0c-4ac9-bb59-61eccf2cb9f6 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:00.503374 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b75392f9-ba0c-4ac9-bb59-61eccf2cb9f6 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:00.504332 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b75392f9-ba0c-4ac9-bb59-61eccf2cb9f6 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:00.616598 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-b75392f9-ba0c-4ac9-bb59-61eccf2cb9f6 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:00.627632 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-b75392f9-ba0c-4ac9-bb59-61eccf2cb9f6 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:00.629287 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-b75392f9-ba0c-4ac9-bb59-61eccf2cb9f6 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:00.630476 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-b75392f9-ba0c-4ac9-bb59-61eccf2cb9f6 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1351 microversion: 2.20 time: 0.148789 Jun 22 10:28:00.631141 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 327/677] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:28:00 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1351 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:28:00.751578 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-ce556ee2-84ce-47f3-bcc9-ba93e87c0269 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:00.759581 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-ce556ee2-84ce-47f3-bcc9-ba93e87c0269 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/d02a6b26-3c65-44a5-8c06-88f9e38f30c7" status: 200 len: 1366 microversion: 2.1 time: 0.287893 Jun 22 10:28:00.760247 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 351/678] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:00 2022] GET /compute/v2.1/servers/d02a6b26-3c65-44a5-8c06-88f9e38f30c7 => generated 1366 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:28:01.650439 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-c43a7226-d11b-4efc-bfaa-81795ef3c71a tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:01.652108 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-c43a7226-d11b-4efc-bfaa-81795ef3c71a tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:01.658777 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c43a7226-d11b-4efc-bfaa-81795ef3c71a tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:01.659238 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c43a7226-d11b-4efc-bfaa-81795ef3c71a tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:01.660028 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c43a7226-d11b-4efc-bfaa-81795ef3c71a tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:01.660462 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c43a7226-d11b-4efc-bfaa-81795ef3c71a tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:01.777565 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-c1aec3ec-bd6a-4cc7-9caf-35567ca93310 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:01.778518 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-c1aec3ec-bd6a-4cc7-9caf-35567ca93310 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: d02a6b26-3c65-44a5-8c06-88f9e38f30c7] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:01.785817 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-c1aec3ec-bd6a-4cc7-9caf-35567ca93310 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:01.786675 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-c1aec3ec-bd6a-4cc7-9caf-35567ca93310 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:01.787604 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-c1aec3ec-bd6a-4cc7-9caf-35567ca93310 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:01.788060 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-c1aec3ec-bd6a-4cc7-9caf-35567ca93310 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:01.932564 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell0:SELECT=2 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:28:02.041424 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-c43a7226-d11b-4efc-bfaa-81795ef3c71a tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:02.050871 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-c43a7226-d11b-4efc-bfaa-81795ef3c71a tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:02.053518 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-c43a7226-d11b-4efc-bfaa-81795ef3c71a tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:02.055312 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-c43a7226-d11b-4efc-bfaa-81795ef3c71a tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1407 microversion: 2.20 time: 0.409609 Jun 22 10:28:02.056311 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 328/679] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:28:01 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1407 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:28:02.164588 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-c1aec3ec-bd6a-4cc7-9caf-35567ca93310 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:02.173522 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-c1aec3ec-bd6a-4cc7-9caf-35567ca93310 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/d02a6b26-3c65-44a5-8c06-88f9e38f30c7" status: 200 len: 1366 microversion: 2.1 time: 0.399830 Jun 22 10:28:02.174287 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 352/680] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:01 2022] GET /compute/v2.1/servers/d02a6b26-3c65-44a5-8c06-88f9e38f30c7 => generated 1366 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:28:02.373538 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-1feab09f-9699-4b8d-8d40-6b96be201146 req-4ef2ac4f-6dc5-4a20-8ea6-9ae742a30392 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d288ac1d-ffb9-4ac1-a5a4-095bf673cea0", "tag": "41f6ee40-8d5d-4ffb-b909-afe6a1d8f347"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:28:02.397751 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-1feab09f-9699-4b8d-8d40-6b96be201146 req-4ef2ac4f-6dc5-4a20-8ea6-9ae742a30392 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:02.399562 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-1feab09f-9699-4b8d-8d40-6b96be201146 req-4ef2ac4f-6dc5-4a20-8ea6-9ae742a30392 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:02.423873 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-1feab09f-9699-4b8d-8d40-6b96be201146 req-4ef2ac4f-6dc5-4a20-8ea6-9ae742a30392 service nova] Creating event network-changed:41f6ee40-8d5d-4ffb-b909-afe6a1d8f347 for instance d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 on hv-cinder-84713 Jun 22 10:28:02.430788 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-1feab09f-9699-4b8d-8d40-6b96be201146 req-4ef2ac4f-6dc5-4a20-8ea6-9ae742a30392 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077147 Jun 22 10:28:02.431706 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 329/681] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:28:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:28:03.076449 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-043533f0-fa65-4f69-9a0b-db546adae544 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:03.077063 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-043533f0-fa65-4f69-9a0b-db546adae544 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:03.084296 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-043533f0-fa65-4f69-9a0b-db546adae544 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:03.084747 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-043533f0-fa65-4f69-9a0b-db546adae544 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:03.085524 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-043533f0-fa65-4f69-9a0b-db546adae544 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:03.085954 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-043533f0-fa65-4f69-9a0b-db546adae544 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:03.191331 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-c04b24d5-ea0b-41d5-8c92-abb2a1b7c5b7 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:03.192126 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-c04b24d5-ea0b-41d5-8c92-abb2a1b7c5b7 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: d02a6b26-3c65-44a5-8c06-88f9e38f30c7] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:03.194900 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=2,nova_api:INSERT=8,nova_api:UPDATE=1 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:28:03.201127 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c04b24d5-ea0b-41d5-8c92-abb2a1b7c5b7 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:03.201680 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c04b24d5-ea0b-41d5-8c92-abb2a1b7c5b7 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:03.202580 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c04b24d5-ea0b-41d5-8c92-abb2a1b7c5b7 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:03.203093 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c04b24d5-ea0b-41d5-8c92-abb2a1b7c5b7 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:03.221515 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-043533f0-fa65-4f69-9a0b-db546adae544 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:03.230696 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-043533f0-fa65-4f69-9a0b-db546adae544 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:03.232199 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-043533f0-fa65-4f69-9a0b-db546adae544 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:03.233360 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-043533f0-fa65-4f69-9a0b-db546adae544 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1407 microversion: 2.20 time: 0.161228 Jun 22 10:28:03.233992 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 353/682] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:28:03 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:28:03.344646 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-c04b24d5-ea0b-41d5-8c92-abb2a1b7c5b7 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:03.352723 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-c04b24d5-ea0b-41d5-8c92-abb2a1b7c5b7 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/d02a6b26-3c65-44a5-8c06-88f9e38f30c7" status: 200 len: 1366 microversion: 2.1 time: 0.165635 Jun 22 10:28:03.353300 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 330/683] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:03 2022] GET /compute/v2.1/servers/d02a6b26-3c65-44a5-8c06-88f9e38f30c7 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:28:03.736517 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-bbb22902-8405-4281-ab9b-13834e6484eb req-79b427d9-c0b3-482a-8f47-514f83be1fc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d02a6b26-3c65-44a5-8c06-88f9e38f30c7", "name": "network-vif-plugged", "status": "completed", "tag": "8133c601-129a-4ea3-a1d7-c165a1a07276"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:28:03.745794 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-bbb22902-8405-4281-ab9b-13834e6484eb req-79b427d9-c0b3-482a-8f47-514f83be1fc9 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:03.746244 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-bbb22902-8405-4281-ab9b-13834e6484eb req-79b427d9-c0b3-482a-8f47-514f83be1fc9 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:03.759574 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-bbb22902-8405-4281-ab9b-13834e6484eb req-79b427d9-c0b3-482a-8f47-514f83be1fc9 service nova] Creating event network-vif-plugged:8133c601-129a-4ea3-a1d7-c165a1a07276 for instance d02a6b26-3c65-44a5-8c06-88f9e38f30c7 on hv-cinder-84713 Jun 22 10:28:03.765377 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-bbb22902-8405-4281-ab9b-13834e6484eb req-79b427d9-c0b3-482a-8f47-514f83be1fc9 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032566 Jun 22 10:28:03.766001 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 354/684] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:28:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:28:04.252028 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-8c0c03a5-b52c-4d29-8234-12ad8d4fd2dd tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:04.252670 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-8c0c03a5-b52c-4d29-8234-12ad8d4fd2dd tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:04.261497 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8c0c03a5-b52c-4d29-8234-12ad8d4fd2dd tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:04.261976 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8c0c03a5-b52c-4d29-8234-12ad8d4fd2dd tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:04.262797 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8c0c03a5-b52c-4d29-8234-12ad8d4fd2dd tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:04.263233 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8c0c03a5-b52c-4d29-8234-12ad8d4fd2dd tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:04.370660 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-e7ed6fa8-a0b2-4cc7-be6b-9ac2841335f8 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:04.371443 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-e7ed6fa8-a0b2-4cc7-be6b-9ac2841335f8 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: d02a6b26-3c65-44a5-8c06-88f9e38f30c7] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:04.378179 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e7ed6fa8-a0b2-4cc7-be6b-9ac2841335f8 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:04.378731 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e7ed6fa8-a0b2-4cc7-be6b-9ac2841335f8 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:04.379800 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e7ed6fa8-a0b2-4cc7-be6b-9ac2841335f8 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:04.380329 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e7ed6fa8-a0b2-4cc7-be6b-9ac2841335f8 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:04.407145 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-8c0c03a5-b52c-4d29-8234-12ad8d4fd2dd tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:04.415777 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-8c0c03a5-b52c-4d29-8234-12ad8d4fd2dd tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:04.417288 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-8c0c03a5-b52c-4d29-8234-12ad8d4fd2dd tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:04.418484 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-8c0c03a5-b52c-4d29-8234-12ad8d4fd2dd tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1407 microversion: 2.20 time: 0.170456 Jun 22 10:28:04.419114 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 331/685] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:28:04 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:28:04.516377 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-e7ed6fa8-a0b2-4cc7-be6b-9ac2841335f8 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:04.524605 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-e7ed6fa8-a0b2-4cc7-be6b-9ac2841335f8 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/d02a6b26-3c65-44a5-8c06-88f9e38f30c7" status: 200 len: 1366 microversion: 2.1 time: 0.158800 Jun 22 10:28:04.525183 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 355/686] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:04 2022] GET /compute/v2.1/servers/d02a6b26-3c65-44a5-8c06-88f9e38f30c7 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:28:05.437173 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-921da742-0105-486f-b5b6-c6db16d27ae4 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:05.437758 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-921da742-0105-486f-b5b6-c6db16d27ae4 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:05.445128 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-921da742-0105-486f-b5b6-c6db16d27ae4 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:05.445570 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-921da742-0105-486f-b5b6-c6db16d27ae4 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:05.446345 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-921da742-0105-486f-b5b6-c6db16d27ae4 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:05.446817 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-921da742-0105-486f-b5b6-c6db16d27ae4 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:05.541437 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-f0ecb143-556b-471c-a808-f1836902fb9b tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:05.542126 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-f0ecb143-556b-471c-a808-f1836902fb9b tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: d02a6b26-3c65-44a5-8c06-88f9e38f30c7] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:05.549641 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f0ecb143-556b-471c-a808-f1836902fb9b tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:05.549857 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f0ecb143-556b-471c-a808-f1836902fb9b tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:05.550696 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f0ecb143-556b-471c-a808-f1836902fb9b tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:05.551514 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f0ecb143-556b-471c-a808-f1836902fb9b tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:05.583609 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-921da742-0105-486f-b5b6-c6db16d27ae4 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:05.592322 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-921da742-0105-486f-b5b6-c6db16d27ae4 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:05.594195 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-921da742-0105-486f-b5b6-c6db16d27ae4 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:05.595669 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-921da742-0105-486f-b5b6-c6db16d27ae4 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1407 microversion: 2.20 time: 0.162444 Jun 22 10:28:05.596429 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 332/687] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:28:05 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:28:05.696733 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-f0ecb143-556b-471c-a808-f1836902fb9b tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:05.708955 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-f0ecb143-556b-471c-a808-f1836902fb9b tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/d02a6b26-3c65-44a5-8c06-88f9e38f30c7" status: 200 len: 1366 microversion: 2.1 time: 0.171218 Jun 22 10:28:05.709531 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 356/688] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:05 2022] GET /compute/v2.1/servers/d02a6b26-3c65-44a5-8c06-88f9e38f30c7 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:28:06.613319 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-78b6f6e4-7ca3-4ed7-a059-c7648b6c67a7 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:06.613919 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-78b6f6e4-7ca3-4ed7-a059-c7648b6c67a7 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:06.621069 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-78b6f6e4-7ca3-4ed7-a059-c7648b6c67a7 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:06.621531 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-78b6f6e4-7ca3-4ed7-a059-c7648b6c67a7 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:06.622326 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-78b6f6e4-7ca3-4ed7-a059-c7648b6c67a7 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:06.622790 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-78b6f6e4-7ca3-4ed7-a059-c7648b6c67a7 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:06.725335 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-8152c36a-df3c-46d0-aa64-76096b186b2a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:06.725980 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-8152c36a-df3c-46d0-aa64-76096b186b2a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: d02a6b26-3c65-44a5-8c06-88f9e38f30c7] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:06.732900 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8152c36a-df3c-46d0-aa64-76096b186b2a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:06.733353 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8152c36a-df3c-46d0-aa64-76096b186b2a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:06.734124 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8152c36a-df3c-46d0-aa64-76096b186b2a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:06.734579 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8152c36a-df3c-46d0-aa64-76096b186b2a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:06.766280 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-78b6f6e4-7ca3-4ed7-a059-c7648b6c67a7 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:06.774797 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-78b6f6e4-7ca3-4ed7-a059-c7648b6c67a7 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:06.776283 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-78b6f6e4-7ca3-4ed7-a059-c7648b6c67a7 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:06.777377 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-78b6f6e4-7ca3-4ed7-a059-c7648b6c67a7 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1407 microversion: 2.20 time: 0.168070 Jun 22 10:28:06.777954 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 333/689] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:28:06 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:28:06.868029 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-8152c36a-df3c-46d0-aa64-76096b186b2a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:06.875769 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-8152c36a-df3c-46d0-aa64-76096b186b2a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/d02a6b26-3c65-44a5-8c06-88f9e38f30c7" status: 200 len: 1366 microversion: 2.1 time: 0.154325 Jun 22 10:28:06.876305 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 357/690] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:06 2022] GET /compute/v2.1/servers/d02a6b26-3c65-44a5-8c06-88f9e38f30c7 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:28:07.713216 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-9ea3604b-cea3-4ac6-b34e-d12ce59a25a8 req-2b6358be-d25e-4628-9af7-94052bd340b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d288ac1d-ffb9-4ac1-a5a4-095bf673cea0", "name": "network-vif-plugged", "status": "completed", "tag": "41f6ee40-8d5d-4ffb-b909-afe6a1d8f347"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:28:07.722267 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-9ea3604b-cea3-4ac6-b34e-d12ce59a25a8 req-2b6358be-d25e-4628-9af7-94052bd340b9 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:07.722920 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-9ea3604b-cea3-4ac6-b34e-d12ce59a25a8 req-2b6358be-d25e-4628-9af7-94052bd340b9 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:07.734843 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-9ea3604b-cea3-4ac6-b34e-d12ce59a25a8 req-2b6358be-d25e-4628-9af7-94052bd340b9 service nova] Creating event network-vif-plugged:41f6ee40-8d5d-4ffb-b909-afe6a1d8f347 for instance d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 on hv-cinder-84713 Jun 22 10:28:07.739854 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-9ea3604b-cea3-4ac6-b34e-d12ce59a25a8 req-2b6358be-d25e-4628-9af7-94052bd340b9 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030253 Jun 22 10:28:07.740476 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 334/691] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:28:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:28:07.795623 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-5c44fce3-755a-4c32-9a7c-912df9ecc300 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:07.796230 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-5c44fce3-755a-4c32-9a7c-912df9ecc300 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:07.803005 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5c44fce3-755a-4c32-9a7c-912df9ecc300 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:07.803457 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5c44fce3-755a-4c32-9a7c-912df9ecc300 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:07.804231 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5c44fce3-755a-4c32-9a7c-912df9ecc300 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:07.804669 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5c44fce3-755a-4c32-9a7c-912df9ecc300 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:07.892611 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-0da39606-a130-400f-a189-cf76028365a1 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:07.893313 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-0da39606-a130-400f-a189-cf76028365a1 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: d02a6b26-3c65-44a5-8c06-88f9e38f30c7] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:07.900011 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0da39606-a130-400f-a189-cf76028365a1 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:07.900456 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0da39606-a130-400f-a189-cf76028365a1 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:07.901229 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0da39606-a130-400f-a189-cf76028365a1 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:07.901648 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0da39606-a130-400f-a189-cf76028365a1 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:07.951804 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-5c44fce3-755a-4c32-9a7c-912df9ecc300 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:07.965305 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-5c44fce3-755a-4c32-9a7c-912df9ecc300 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:07.967001 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-5c44fce3-755a-4c32-9a7c-912df9ecc300 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:07.968384 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-5c44fce3-755a-4c32-9a7c-912df9ecc300 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1407 microversion: 2.20 time: 0.176726 Jun 22 10:28:07.968935 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 358/692] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:28:07 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:28:08.038569 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-0da39606-a130-400f-a189-cf76028365a1 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:08.047136 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-0da39606-a130-400f-a189-cf76028365a1 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/d02a6b26-3c65-44a5-8c06-88f9e38f30c7" status: 200 len: 1366 microversion: 2.1 time: 0.158771 Jun 22 10:28:08.051597 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 335/693] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:07 2022] GET /compute/v2.1/servers/d02a6b26-3c65-44a5-8c06-88f9e38f30c7 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:28:08.986005 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-1a892558-e664-46d1-8723-314885801cb1 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:08.986667 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-1a892558-e664-46d1-8723-314885801cb1 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:08.995170 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1a892558-e664-46d1-8723-314885801cb1 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:08.995612 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1a892558-e664-46d1-8723-314885801cb1 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:08.996403 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1a892558-e664-46d1-8723-314885801cb1 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:08.996835 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1a892558-e664-46d1-8723-314885801cb1 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:09.000051 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:SELECT=100 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:28:09.065020 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-05f1da35-0263-4c03-964b-947d26c9613b tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:09.065623 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-05f1da35-0263-4c03-964b-947d26c9613b tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: d02a6b26-3c65-44a5-8c06-88f9e38f30c7] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:09.072002 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-05f1da35-0263-4c03-964b-947d26c9613b tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:09.072451 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-05f1da35-0263-4c03-964b-947d26c9613b tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:09.073212 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-05f1da35-0263-4c03-964b-947d26c9613b tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:09.073648 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-05f1da35-0263-4c03-964b-947d26c9613b tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:09.176173 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-1a892558-e664-46d1-8723-314885801cb1 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:09.184855 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-1a892558-e664-46d1-8723-314885801cb1 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:09.186367 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-1a892558-e664-46d1-8723-314885801cb1 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:09.187655 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-1a892558-e664-46d1-8723-314885801cb1 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1407 microversion: 2.20 time: 0.205776 Jun 22 10:28:09.188455 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 359/694] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:28:08 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1407 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:28:09.221739 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-05f1da35-0263-4c03-964b-947d26c9613b tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:09.229679 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-05f1da35-0263-4c03-964b-947d26c9613b tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/d02a6b26-3c65-44a5-8c06-88f9e38f30c7" status: 200 len: 1557 microversion: 2.1 time: 0.168690 Jun 22 10:28:09.230248 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 336/695] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:09 2022] GET /compute/v2.1/servers/d02a6b26-3c65-44a5-8c06-88f9e38f30c7 => generated 1557 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:28:09.246388 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-5ac8345a-fb90-47d8-a412-ab7853e47513 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:09.246615 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-5ac8345a-fb90-47d8-a412-ab7853e47513 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: d02a6b26-3c65-44a5-8c06-88f9e38f30c7] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:09.253345 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5ac8345a-fb90-47d8-a412-ab7853e47513 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:09.254094 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5ac8345a-fb90-47d8-a412-ab7853e47513 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:09.254713 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5ac8345a-fb90-47d8-a412-ab7853e47513 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:09.255224 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5ac8345a-fb90-47d8-a412-ab7853e47513 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:09.333525 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-5ac8345a-fb90-47d8-a412-ab7853e47513 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/d02a6b26-3c65-44a5-8c06-88f9e38f30c7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091345 Jun 22 10:28:09.334149 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 360/696] 10.222.0.66 () {58 vars in 1274 bytes} [Wed Jun 22 10:28:09 2022] GET /compute/v2.1/servers/d02a6b26-3c65-44a5-8c06-88f9e38f30c7/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:28:10.206606 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-856c4a98-c835-4cfd-91b8-14cc739bb03d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:10.207231 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-856c4a98-c835-4cfd-91b8-14cc739bb03d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:10.209717 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_cell0:SELECT=4 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:28:10.210533 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_cell0:SELECT=22 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:28:10.217492 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-856c4a98-c835-4cfd-91b8-14cc739bb03d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:10.217943 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-856c4a98-c835-4cfd-91b8-14cc739bb03d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:10.218765 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-856c4a98-c835-4cfd-91b8-14cc739bb03d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:10.219203 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-856c4a98-c835-4cfd-91b8-14cc739bb03d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:10.443019 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-856c4a98-c835-4cfd-91b8-14cc739bb03d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:10.452816 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-856c4a98-c835-4cfd-91b8-14cc739bb03d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:10.454595 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-856c4a98-c835-4cfd-91b8-14cc739bb03d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:10.456143 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-856c4a98-c835-4cfd-91b8-14cc739bb03d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1407 microversion: 2.20 time: 0.254015 Jun 22 10:28:10.457105 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 337/697] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:28:10 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1407 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:28:10.608015 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-6ab7d0ff-fab2-4f20-96ad-73c3ef2eac72 req-4d812fbc-77b5-4910-bb01-80815d8c6a80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d02a6b26-3c65-44a5-8c06-88f9e38f30c7", "tag": "8133c601-129a-4ea3-a1d7-c165a1a07276"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:28:10.616345 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-6ab7d0ff-fab2-4f20-96ad-73c3ef2eac72 req-4d812fbc-77b5-4910-bb01-80815d8c6a80 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:10.616835 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-6ab7d0ff-fab2-4f20-96ad-73c3ef2eac72 req-4d812fbc-77b5-4910-bb01-80815d8c6a80 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:10.628470 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-6ab7d0ff-fab2-4f20-96ad-73c3ef2eac72 req-4d812fbc-77b5-4910-bb01-80815d8c6a80 service nova] Creating event network-changed:8133c601-129a-4ea3-a1d7-c165a1a07276 for instance d02a6b26-3c65-44a5-8c06-88f9e38f30c7 on hv-cinder-84713 Jun 22 10:28:10.633703 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-6ab7d0ff-fab2-4f20-96ad-73c3ef2eac72 req-4d812fbc-77b5-4910-bb01-80815d8c6a80 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029839 Jun 22 10:28:10.634652 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 361/698] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:28:11.476166 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-288f3785-f43a-47df-91ed-122b1d942ded tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:11.476784 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-288f3785-f43a-47df-91ed-122b1d942ded tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:11.484855 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-288f3785-f43a-47df-91ed-122b1d942ded tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:11.485302 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-288f3785-f43a-47df-91ed-122b1d942ded tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:11.486087 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-288f3785-f43a-47df-91ed-122b1d942ded tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:11.486559 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-288f3785-f43a-47df-91ed-122b1d942ded tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:11.626268 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-288f3785-f43a-47df-91ed-122b1d942ded tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:11.635045 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-288f3785-f43a-47df-91ed-122b1d942ded tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:11.636547 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-288f3785-f43a-47df-91ed-122b1d942ded tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:11.637707 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-288f3785-f43a-47df-91ed-122b1d942ded tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1598 microversion: 2.20 time: 0.165785 Jun 22 10:28:11.638430 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 338/699] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:28:11 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1598 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:28:11.657070 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-14a9ce95-bbf3-458a-a2c4-74b439b670e4 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:11.657664 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-14a9ce95-bbf3-458a-a2c4-74b439b670e4 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:11.665883 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-14a9ce95-bbf3-458a-a2c4-74b439b670e4 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:11.667044 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-14a9ce95-bbf3-458a-a2c4-74b439b670e4 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:11.667855 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-14a9ce95-bbf3-458a-a2c4-74b439b670e4 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:11.678235 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-14a9ce95-bbf3-458a-a2c4-74b439b670e4 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:11.748644 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-14a9ce95-bbf3-458a-a2c4-74b439b670e4 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.096994 Jun 22 10:28:11.749285 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 362/700] 10.222.0.66 () {60 vars in 1315 bytes} [Wed Jun 22 10:28:11 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 10:28:12.702918 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-32e1641f-9c3a-4765-8075-f57c8fb4813c req-02de6cf3-f1d5-4d7e-83e9-f87c7dc768f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d288ac1d-ffb9-4ac1-a5a4-095bf673cea0", "tag": "41f6ee40-8d5d-4ffb-b909-afe6a1d8f347"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:28:12.712234 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-32e1641f-9c3a-4765-8075-f57c8fb4813c req-02de6cf3-f1d5-4d7e-83e9-f87c7dc768f3 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:12.712675 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-32e1641f-9c3a-4765-8075-f57c8fb4813c req-02de6cf3-f1d5-4d7e-83e9-f87c7dc768f3 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:12.724404 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-32e1641f-9c3a-4765-8075-f57c8fb4813c req-02de6cf3-f1d5-4d7e-83e9-f87c7dc768f3 service nova] Creating event network-changed:41f6ee40-8d5d-4ffb-b909-afe6a1d8f347 for instance d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 on hv-cinder-84713 Jun 22 10:28:12.730172 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-32e1641f-9c3a-4765-8075-f57c8fb4813c req-02de6cf3-f1d5-4d7e-83e9-f87c7dc768f3 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031120 Jun 22 10:28:12.731234 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 339/701] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:28:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:28:21.409470 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-3793f0b8-4216-4e66-ac79-c71ae7a03000 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:21.410049 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-3793f0b8-4216-4e66-ac79-c71ae7a03000 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 156c832e-e672-428f-9404-1e2964ae5609] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:21.412107 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:28:21.417698 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3793f0b8-4216-4e66-ac79-c71ae7a03000 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:21.418149 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3793f0b8-4216-4e66-ac79-c71ae7a03000 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:21.418973 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3793f0b8-4216-4e66-ac79-c71ae7a03000 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:21.419553 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3793f0b8-4216-4e66-ac79-c71ae7a03000 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:21.503663 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.objects.instance [None req-3793f0b8-4216-4e66-ac79-c71ae7a03000 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lazy-loading 'services' on Instance uuid 156c832e-e672-428f-9404-1e2964ae5609 {{(pid=117680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:28:21.584382 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-3793f0b8-4216-4e66-ac79-c71ae7a03000 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "DELETE /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609/os-volume_attachments/5fd6dc7d-56d3-454f-b891-90fcf015c968" status: 202 len: 0 microversion: 2.1 time: 0.179429 Jun 22 10:28:21.585137 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 363/702] 10.222.0.66 () {58 vars in 1415 bytes} [Wed Jun 22 10:28:21 2022] DELETE /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609/os-volume_attachments/5fd6dc7d-56d3-454f-b891-90fcf015c968 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:28:21.596276 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-5482412d-41a7-4031-9062-e3ab7f5a5391 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:21.597411 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-5482412d-41a7-4031-9062-e3ab7f5a5391 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 156c832e-e672-428f-9404-1e2964ae5609] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:21.605135 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5482412d-41a7-4031-9062-e3ab7f5a5391 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:21.605641 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5482412d-41a7-4031-9062-e3ab7f5a5391 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:21.606471 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5482412d-41a7-4031-9062-e3ab7f5a5391 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:21.606958 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5482412d-41a7-4031-9062-e3ab7f5a5391 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:21.639822 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-5482412d-41a7-4031-9062-e3ab7f5a5391 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048571 Jun 22 10:28:21.640322 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 340/703] 10.222.0.66 () {58 vars in 1301 bytes} [Wed Jun 22 10:28:21 2022] GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:28:22.654315 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-c26b680c-1e91-42ae-bd3a-ecfce93216cb tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:22.655433 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-c26b680c-1e91-42ae-bd3a-ecfce93216cb tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 156c832e-e672-428f-9404-1e2964ae5609] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:22.662687 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-c26b680c-1e91-42ae-bd3a-ecfce93216cb tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:22.663135 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-c26b680c-1e91-42ae-bd3a-ecfce93216cb tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:22.663933 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-c26b680c-1e91-42ae-bd3a-ecfce93216cb tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:22.664392 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-c26b680c-1e91-42ae-bd3a-ecfce93216cb tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:22.694640 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-c26b680c-1e91-42ae-bd3a-ecfce93216cb tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045667 Jun 22 10:28:22.695202 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 364/704] 10.222.0.66 () {58 vars in 1301 bytes} [Wed Jun 22 10:28:22 2022] GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 22 10:28:22.767134 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-e7e0db2a-0998-4ee7-80dc-ae27a7bb426b tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:22.767672 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-e7e0db2a-0998-4ee7-80dc-ae27a7bb426b tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 156c832e-e672-428f-9404-1e2964ae5609] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:22.774223 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e7e0db2a-0998-4ee7-80dc-ae27a7bb426b tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:22.774703 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e7e0db2a-0998-4ee7-80dc-ae27a7bb426b tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:22.775488 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e7e0db2a-0998-4ee7-80dc-ae27a7bb426b tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:22.775922 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e7e0db2a-0998-4ee7-80dc-ae27a7bb426b tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:22.801941 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-e7e0db2a-0998-4ee7-80dc-ae27a7bb426b tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 156c832e-e672-428f-9404-1e2964ae5609] Going to try to terminate instance {{(pid=117679) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 10:28:22.854493 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:28:22.886685 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-e7e0db2a-0998-4ee7-80dc-ae27a7bb426b tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "DELETE /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609" status: 204 len: 0 microversion: 2.1 time: 0.123122 Jun 22 10:28:22.887281 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 341/705] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Jun 22 10:28:22 2022] DELETE /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 10:28:22.895918 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-78b2f58e-2643-469d-87c7-15f1ae03ae80 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:22.896529 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-78b2f58e-2643-469d-87c7-15f1ae03ae80 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 156c832e-e672-428f-9404-1e2964ae5609] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:22.902865 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-78b2f58e-2643-469d-87c7-15f1ae03ae80 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:22.903630 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-78b2f58e-2643-469d-87c7-15f1ae03ae80 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:22.904393 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-78b2f58e-2643-469d-87c7-15f1ae03ae80 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:22.904825 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-78b2f58e-2643-469d-87c7-15f1ae03ae80 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:23.040734 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-78b2f58e-2643-469d-87c7-15f1ae03ae80 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:23.048483 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-78b2f58e-2643-469d-87c7-15f1ae03ae80 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609" status: 200 len: 1687 microversion: 2.1 time: 0.156670 Jun 22 10:28:23.049183 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 365/706] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:22 2022] GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609 => generated 1687 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:28:24.066760 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-4de0e408-e7eb-474d-88b1-d32c1f236361 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:24.067426 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-4de0e408-e7eb-474d-88b1-d32c1f236361 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 156c832e-e672-428f-9404-1e2964ae5609] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:24.074299 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4de0e408-e7eb-474d-88b1-d32c1f236361 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:24.074835 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4de0e408-e7eb-474d-88b1-d32c1f236361 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:24.075601 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4de0e408-e7eb-474d-88b1-d32c1f236361 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:24.076030 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4de0e408-e7eb-474d-88b1-d32c1f236361 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:24.213541 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-4de0e408-e7eb-474d-88b1-d32c1f236361 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:24.221758 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-4de0e408-e7eb-474d-88b1-d32c1f236361 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609" status: 200 len: 1687 microversion: 2.1 time: 0.159322 Jun 22 10:28:24.222312 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 342/707] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:24 2022] GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609 => generated 1687 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:28:25.239479 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-80fb263c-6721-4b0b-a177-bf3409710efa tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:25.240078 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-80fb263c-6721-4b0b-a177-bf3409710efa tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 156c832e-e672-428f-9404-1e2964ae5609] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:25.247110 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-80fb263c-6721-4b0b-a177-bf3409710efa tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:25.247565 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-80fb263c-6721-4b0b-a177-bf3409710efa tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:25.248353 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-80fb263c-6721-4b0b-a177-bf3409710efa tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:25.248797 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-80fb263c-6721-4b0b-a177-bf3409710efa tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:25.386287 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-80fb263c-6721-4b0b-a177-bf3409710efa tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:25.393951 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-80fb263c-6721-4b0b-a177-bf3409710efa tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609" status: 200 len: 1687 microversion: 2.1 time: 0.158476 Jun 22 10:28:25.394654 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 366/708] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:25 2022] GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609 => generated 1687 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:28:26.412001 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-04fd4319-8228-4541-83e8-23d7c6959335 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:26.412635 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-04fd4319-8228-4541-83e8-23d7c6959335 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 156c832e-e672-428f-9404-1e2964ae5609] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:26.419727 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-04fd4319-8228-4541-83e8-23d7c6959335 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:26.420177 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-04fd4319-8228-4541-83e8-23d7c6959335 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:26.420976 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-04fd4319-8228-4541-83e8-23d7c6959335 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:26.421469 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-04fd4319-8228-4541-83e8-23d7c6959335 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:26.555499 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-04fd4319-8228-4541-83e8-23d7c6959335 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:26.563193 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-04fd4319-8228-4541-83e8-23d7c6959335 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609" status: 200 len: 1687 microversion: 2.1 time: 0.155275 Jun 22 10:28:26.563762 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 343/709] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:26 2022] GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609 => generated 1687 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:28:27.580730 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-b5b7c361-c69e-4e29-b2f1-643052be486a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:27.581378 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-b5b7c361-c69e-4e29-b2f1-643052be486a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 156c832e-e672-428f-9404-1e2964ae5609] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:27.588832 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b5b7c361-c69e-4e29-b2f1-643052be486a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:27.589284 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b5b7c361-c69e-4e29-b2f1-643052be486a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:27.590052 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b5b7c361-c69e-4e29-b2f1-643052be486a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:27.590481 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b5b7c361-c69e-4e29-b2f1-643052be486a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:27.665127 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-b5b7c361-c69e-4e29-b2f1-643052be486a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:27.673232 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-b5b7c361-c69e-4e29-b2f1-643052be486a tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609" status: 200 len: 1620 microversion: 2.1 time: 0.096522 Jun 22 10:28:27.673821 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 367/710] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:27 2022] GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609 => generated 1620 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:28:27.792653 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-99fc8c8f-71de-44b3-bd3f-d51e14bd87f6 req-59811393-4ee0-48fe-8225-62ef73dfe314 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "156c832e-e672-428f-9404-1e2964ae5609", "name": "network-vif-deleted", "tag": "d5a527b2-317f-467a-b39d-b955e3a5dea6"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:28:27.806273 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-99fc8c8f-71de-44b3-bd3f-d51e14bd87f6 req-59811393-4ee0-48fe-8225-62ef73dfe314 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:27.807095 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-99fc8c8f-71de-44b3-bd3f-d51e14bd87f6 req-59811393-4ee0-48fe-8225-62ef73dfe314 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:27.825082 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-99fc8c8f-71de-44b3-bd3f-d51e14bd87f6 req-59811393-4ee0-48fe-8225-62ef73dfe314 service nova] Creating event network-vif-deleted:d5a527b2-317f-467a-b39d-b955e3a5dea6 for instance 156c832e-e672-428f-9404-1e2964ae5609 on hv-cinder-84713 Jun 22 10:28:27.830215 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-99fc8c8f-71de-44b3-bd3f-d51e14bd87f6 req-59811393-4ee0-48fe-8225-62ef73dfe314 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043238 Jun 22 10:28:27.831204 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 344/711] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:28:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:28:28.690967 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-dd896c38-8237-43c6-92af-43ab6b9f09a0 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:28.691615 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-dd896c38-8237-43c6-92af-43ab6b9f09a0 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 156c832e-e672-428f-9404-1e2964ae5609] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:28.698525 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-dd896c38-8237-43c6-92af-43ab6b9f09a0 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:28.698971 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-dd896c38-8237-43c6-92af-43ab6b9f09a0 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:28.699907 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-dd896c38-8237-43c6-92af-43ab6b9f09a0 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:28.700341 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-dd896c38-8237-43c6-92af-43ab6b9f09a0 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:28.715450 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.wsgi [None req-dd896c38-8237-43c6-92af-43ab6b9f09a0 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] HTTP exception thrown: Instance 156c832e-e672-428f-9404-1e2964ae5609 could not be found. Jun 22 10:28:28.717104 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-dd896c38-8237-43c6-92af-43ab6b9f09a0 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Request method failure captured: Jun 22 10:28:28.717104 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: request: GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609 HTTP/1.1 Jun 22 10:28:28.717104 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Accept: application/json Jun 22 10:28:28.717104 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Accept-Encoding: identity Jun 22 10:28:28.717104 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Connection: close Jun 22 10:28:28.717104 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Content-Length: 0 Jun 22 10:28:28.717104 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Content-Type: application/json Jun 22 10:28:28.717104 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Host: 10.222.0.66 Jun 22 10:28:28.717104 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Openstack-System-Scope: None Jun 22 10:28:28.717104 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: User-Agent: python-urllib3/1.26.9 Jun 22 10:28:28.717104 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Auth-Token: gAAAAABisu0KTX4LByDrs2wd0wf7QkjgZCYL58jTaGKxU6GloV6S5vTA8f4YmIXgHT_KMAgKu1jdsn-8Uga7Qnln7YVuKutNjZ4Xn3tAFNoo7zG8SK5VuNoRcwHUn_V5P08hyf2Bosoz8F0t6BB7YpwwfdbxZ3fftIbWEfVknGZuJ2vKr7E2QFU Jun 22 10:28:28.717104 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Domain-Id: None Jun 22 10:28:28.717104 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Domain-Name: None Jun 22 10:28:28.717104 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Identity-Status: Confirmed Jun 22 10:28:28.717104 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Is-Admin-Project: True Jun 22 10:28:28.717104 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Domain-Id: default Jun 22 10:28:28.717104 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Domain-Name: Default Jun 22 10:28:28.717104 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Id: f20791fa785649cfa5df1f60df84dbdb Jun 22 10:28:28.717104 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2082763206 Jun 22 10:28:28.717104 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Role: member,reader Jun 22 10:28:28.717104 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Roles: member,reader Jun 22 10:28:28.718924 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f20791fa785649cfa5df1f60df84dbdb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f20791fa785649cfa5df1f60df84dbdb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f20791fa785649cfa5df1f60df84dbdb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f20791fa785649cfa5df1f60df84dbdb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}] Jun 22 10:28:28.718924 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2082763206 Jun 22 10:28:28.718924 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant-Id: f20791fa785649cfa5df1f60df84dbdb Jun 22 10:28:28.718924 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2082763206 Jun 22 10:28:28.718924 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User: tempest-ServerRescueNegativeTestJSON-2082763206-project Jun 22 10:28:28.718924 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Domain-Id: default Jun 22 10:28:28.718924 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Domain-Name: Default Jun 22 10:28:28.718924 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Id: 8fc916f852f4433eac4a3a2a12384834 Jun 22 10:28:28.718924 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2082763206-project Jun 22 10:28:28.718924 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: method: > Jun 22 10:28:28.718924 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: exception: Instance 156c832e-e672-428f-9404-1e2964ae5609 could not be found. Jun 22 10:28:28.718924 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: action_args: {'id': '156c832e-e672-428f-9404-1e2964ae5609'} Jun 22 10:28:28.720381 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:28:28.720381 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:28:28.720381 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:28:28.720381 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:28:28.720381 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:28:28.720381 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:28:28.720381 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:28:28.720381 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:28:28.720381 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:28:28.720381 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:28:28.720381 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 156c832e-e672-428f-9404-1e2964ae5609 could not be found. Jun 22 10:28:28.720381 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:28:28.720381 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:28:28.720381 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:28:28.720381 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:28:28.720381 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:28:28.720381 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:28:28.720381 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:28:28.720381 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:28:28.720381 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:28:28.721953 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:28:28.721953 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:28:28.721953 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:28:28.721953 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:28:28.721953 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:28:28.721953 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:28:28.721953 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:28:28.721953 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 156c832e-e672-428f-9404-1e2964ae5609 could not be found. Jun 22 10:28:28.721953 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:28:28.721953 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:28:28.721953 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:28:28.721953 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:28:28.721953 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:28:28.721953 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:28:28.721953 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:28:28.721953 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:28:28.721953 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 156c832e-e672-428f-9404-1e2964ae5609 could not be found. Jun 22 10:28:28.721953 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:28:28.723516 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-dd896c38-8237-43c6-92af-43ab6b9f09a0 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Returning 404 to user: Instance 156c832e-e672-428f-9404-1e2964ae5609 could not be found. {{(pid=117680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:28:28.723516 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-dd896c38-8237-43c6-92af-43ab6b9f09a0 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609" status: 404 len: 111 microversion: 2.1 time: 0.031684 Jun 22 10:28:28.723516 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 368/712] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:28 2022] GET /compute/v2.1/servers/156c832e-e672-428f-9404-1e2964ae5609 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:28:28.729589 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-ebe70654-5afc-4b7d-88d6-e348dfa06ffb tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '.version_select at 0x7f60d9f02280>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:28.748122 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-ebe70654-5afc-4b7d-88d6-e348dfa06ffb tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2038482948" status: 202 len: 0 microversion: 2.1 time: 0.022764 Jun 22 10:28:28.749468 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 345/713] 10.222.0.66 () {58 vars in 1220 bytes} [Wed Jun 22 10:28:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2038482948 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:28:31.667529 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-95fc7edc-75ba-4473-8474-9ebdbf9478c7 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:31.668097 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-95fc7edc-75ba-4473-8474-9ebdbf9478c7 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:31.675213 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-95fc7edc-75ba-4473-8474-9ebdbf9478c7 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:31.675657 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-95fc7edc-75ba-4473-8474-9ebdbf9478c7 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:31.676427 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-95fc7edc-75ba-4473-8474-9ebdbf9478c7 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:31.676857 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-95fc7edc-75ba-4473-8474-9ebdbf9478c7 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:31.703372 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-95fc7edc-75ba-4473-8474-9ebdbf9478c7 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Going to try to terminate instance {{(pid=117680) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 10:28:31.786163 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-95fc7edc-75ba-4473-8474-9ebdbf9478c7 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "DELETE /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 204 len: 0 microversion: 2.1 time: 0.122120 Jun 22 10:28:31.786781 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 369/714] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Jun 22 10:28:31 2022] DELETE /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 10:28:31.798397 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-6506abb7-8f85-4eeb-b325-b5f533c8d823 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:31.799412 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-6506abb7-8f85-4eeb-b325-b5f533c8d823 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:31.806352 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6506abb7-8f85-4eeb-b325-b5f533c8d823 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:31.806867 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6506abb7-8f85-4eeb-b325-b5f533c8d823 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:31.807645 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6506abb7-8f85-4eeb-b325-b5f533c8d823 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:31.808109 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6506abb7-8f85-4eeb-b325-b5f533c8d823 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:31.944938 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-6506abb7-8f85-4eeb-b325-b5f533c8d823 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:31.952504 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-6506abb7-8f85-4eeb-b325-b5f533c8d823 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1507 microversion: 2.1 time: 0.161495 Jun 22 10:28:31.953095 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 346/715] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:31 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:28:32.970808 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-1d118927-b2c7-4e0f-9128-63fc8134d8f3 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:32.972279 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-1d118927-b2c7-4e0f-9128-63fc8134d8f3 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:32.981657 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1d118927-b2c7-4e0f-9128-63fc8134d8f3 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:32.982818 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1d118927-b2c7-4e0f-9128-63fc8134d8f3 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:32.984537 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1d118927-b2c7-4e0f-9128-63fc8134d8f3 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:32.985276 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1d118927-b2c7-4e0f-9128-63fc8134d8f3 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:33.073336 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-a3d26354-98ac-43ef-99eb-d3f3956e305c req-9bf37431-4ec7-4218-ae37-2dc15f91ab61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74f2497c-d91a-47be-b505-090e99ab9c52", "name": "network-vif-deleted", "tag": "2c6f6652-0c2f-4ac8-85d8-e42607054324"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:28:33.092146 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-1d118927-b2c7-4e0f-9128-63fc8134d8f3 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:33.107163 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-1d118927-b2c7-4e0f-9128-63fc8134d8f3 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 200 len: 1465 microversion: 2.1 time: 0.140787 Jun 22 10:28:33.108855 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 370/716] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:32 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 1465 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:28:33.112431 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-a3d26354-98ac-43ef-99eb-d3f3956e305c req-9bf37431-4ec7-4218-ae37-2dc15f91ab61 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:33.113994 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-a3d26354-98ac-43ef-99eb-d3f3956e305c req-9bf37431-4ec7-4218-ae37-2dc15f91ab61 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:33.135134 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-a3d26354-98ac-43ef-99eb-d3f3956e305c req-9bf37431-4ec7-4218-ae37-2dc15f91ab61 service nova] Creating event network-vif-deleted:2c6f6652-0c2f-4ac8-85d8-e42607054324 for instance 74f2497c-d91a-47be-b505-090e99ab9c52 on hv-cinder-84713 Jun 22 10:28:33.143593 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-a3d26354-98ac-43ef-99eb-d3f3956e305c req-9bf37431-4ec7-4218-ae37-2dc15f91ab61 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081332 Jun 22 10:28:33.145431 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 347/717] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:28:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:28:34.125454 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-bf88a51f-b242-4360-99be-78d324f3fae9 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:34.126054 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-bf88a51f-b242-4360-99be-78d324f3fae9 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 74f2497c-d91a-47be-b505-090e99ab9c52] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:34.133251 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-bf88a51f-b242-4360-99be-78d324f3fae9 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:34.133705 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-bf88a51f-b242-4360-99be-78d324f3fae9 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:34.134472 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-bf88a51f-b242-4360-99be-78d324f3fae9 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:34.134928 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-bf88a51f-b242-4360-99be-78d324f3fae9 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:34.148859 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.wsgi [None req-bf88a51f-b242-4360-99be-78d324f3fae9 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] HTTP exception thrown: Instance 74f2497c-d91a-47be-b505-090e99ab9c52 could not be found. Jun 22 10:28:34.150547 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-bf88a51f-b242-4360-99be-78d324f3fae9 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Request method failure captured: Jun 22 10:28:34.150547 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: request: GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 HTTP/1.1 Jun 22 10:28:34.150547 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Accept: application/json Jun 22 10:28:34.150547 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Accept-Encoding: identity Jun 22 10:28:34.150547 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Connection: close Jun 22 10:28:34.150547 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Content-Length: 0 Jun 22 10:28:34.150547 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Content-Type: application/json Jun 22 10:28:34.150547 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Host: 10.222.0.66 Jun 22 10:28:34.150547 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Openstack-System-Scope: None Jun 22 10:28:34.150547 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: User-Agent: python-urllib3/1.26.9 Jun 22 10:28:34.150547 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Auth-Token: gAAAAABisu0KTX4LByDrs2wd0wf7QkjgZCYL58jTaGKxU6GloV6S5vTA8f4YmIXgHT_KMAgKu1jdsn-8Uga7Qnln7YVuKutNjZ4Xn3tAFNoo7zG8SK5VuNoRcwHUn_V5P08hyf2Bosoz8F0t6BB7YpwwfdbxZ3fftIbWEfVknGZuJ2vKr7E2QFU Jun 22 10:28:34.150547 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Domain-Id: None Jun 22 10:28:34.150547 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Domain-Name: None Jun 22 10:28:34.150547 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Identity-Status: Confirmed Jun 22 10:28:34.150547 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Is-Admin-Project: True Jun 22 10:28:34.150547 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Domain-Id: default Jun 22 10:28:34.150547 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Domain-Name: Default Jun 22 10:28:34.150547 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Id: f20791fa785649cfa5df1f60df84dbdb Jun 22 10:28:34.150547 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2082763206 Jun 22 10:28:34.150547 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Role: member,reader Jun 22 10:28:34.150547 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Roles: member,reader Jun 22 10:28:34.152118 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f20791fa785649cfa5df1f60df84dbdb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f20791fa785649cfa5df1f60df84dbdb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f20791fa785649cfa5df1f60df84dbdb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f20791fa785649cfa5df1f60df84dbdb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}] Jun 22 10:28:34.152118 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2082763206 Jun 22 10:28:34.152118 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant-Id: f20791fa785649cfa5df1f60df84dbdb Jun 22 10:28:34.152118 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2082763206 Jun 22 10:28:34.152118 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User: tempest-ServerRescueNegativeTestJSON-2082763206-project Jun 22 10:28:34.152118 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Domain-Id: default Jun 22 10:28:34.152118 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Domain-Name: Default Jun 22 10:28:34.152118 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Id: 8fc916f852f4433eac4a3a2a12384834 Jun 22 10:28:34.152118 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2082763206-project Jun 22 10:28:34.152118 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: method: > Jun 22 10:28:34.152118 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: exception: Instance 74f2497c-d91a-47be-b505-090e99ab9c52 could not be found. Jun 22 10:28:34.152118 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: action_args: {'id': '74f2497c-d91a-47be-b505-090e99ab9c52'} Jun 22 10:28:34.152916 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:28:34.152916 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:28:34.152916 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:28:34.152916 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:28:34.152916 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:28:34.152916 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:28:34.152916 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:28:34.152916 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:28:34.152916 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:28:34.152916 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:28:34.152916 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74f2497c-d91a-47be-b505-090e99ab9c52 could not be found. Jun 22 10:28:34.152916 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:28:34.152916 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:28:34.152916 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:28:34.152916 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:28:34.152916 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:28:34.152916 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:28:34.152916 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:28:34.152916 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:28:34.152916 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:28:34.154660 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:28:34.154660 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:28:34.154660 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:28:34.154660 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:28:34.154660 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:28:34.154660 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:28:34.154660 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:28:34.154660 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74f2497c-d91a-47be-b505-090e99ab9c52 could not be found. Jun 22 10:28:34.154660 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:28:34.154660 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:28:34.154660 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:28:34.154660 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:28:34.154660 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:28:34.154660 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:28:34.154660 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:28:34.154660 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:28:34.154660 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74f2497c-d91a-47be-b505-090e99ab9c52 could not be found. Jun 22 10:28:34.154660 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:28:34.156260 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-bf88a51f-b242-4360-99be-78d324f3fae9 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Returning 404 to user: Instance 74f2497c-d91a-47be-b505-090e99ab9c52 could not be found. {{(pid=117680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:28:34.156260 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-bf88a51f-b242-4360-99be-78d324f3fae9 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52" status: 404 len: 111 microversion: 2.1 time: 0.030424 Jun 22 10:28:34.156260 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 371/718] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:34 2022] GET /compute/v2.1/servers/74f2497c-d91a-47be-b505-090e99ab9c52 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:28:34.162067 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-01bf097e-e5c5-4d7c-a7af-a1f4fd80f8c1 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:34.162686 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-01bf097e-e5c5-4d7c-a7af-a1f4fd80f8c1 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 739e9dbf-4ccc-4022-83e4-d2f4c36955ee] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:34.164640 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:28:34.170582 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-01bf097e-e5c5-4d7c-a7af-a1f4fd80f8c1 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:34.170993 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-01bf097e-e5c5-4d7c-a7af-a1f4fd80f8c1 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:34.171766 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-01bf097e-e5c5-4d7c-a7af-a1f4fd80f8c1 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:34.172202 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-01bf097e-e5c5-4d7c-a7af-a1f4fd80f8c1 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:34.199108 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-01bf097e-e5c5-4d7c-a7af-a1f4fd80f8c1 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 739e9dbf-4ccc-4022-83e4-d2f4c36955ee] Going to try to terminate instance {{(pid=117679) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 10:28:34.279820 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-01bf097e-e5c5-4d7c-a7af-a1f4fd80f8c1 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "DELETE /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee" status: 204 len: 0 microversion: 2.1 time: 0.122134 Jun 22 10:28:34.280426 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 348/719] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Jun 22 10:28:34 2022] DELETE /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 10:28:34.289179 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-0c0e7f1b-a2fe-4241-a23f-f30eb9ad2053 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:34.289866 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-0c0e7f1b-a2fe-4241-a23f-f30eb9ad2053 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 739e9dbf-4ccc-4022-83e4-d2f4c36955ee] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:34.296306 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0c0e7f1b-a2fe-4241-a23f-f30eb9ad2053 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:34.296757 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0c0e7f1b-a2fe-4241-a23f-f30eb9ad2053 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:34.297541 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0c0e7f1b-a2fe-4241-a23f-f30eb9ad2053 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:34.297979 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0c0e7f1b-a2fe-4241-a23f-f30eb9ad2053 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:34.436768 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-0c0e7f1b-a2fe-4241-a23f-f30eb9ad2053 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:34.444468 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-0c0e7f1b-a2fe-4241-a23f-f30eb9ad2053 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee" status: 200 len: 1522 microversion: 2.1 time: 0.159298 Jun 22 10:28:34.445032 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 372/720] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:34 2022] GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:28:35.461591 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-49e4150a-b59f-41f1-8cb3-68887fd11afb tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:35.462361 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-49e4150a-b59f-41f1-8cb3-68887fd11afb tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 739e9dbf-4ccc-4022-83e4-d2f4c36955ee] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:35.469279 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-49e4150a-b59f-41f1-8cb3-68887fd11afb tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:35.469719 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-49e4150a-b59f-41f1-8cb3-68887fd11afb tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:35.470477 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-49e4150a-b59f-41f1-8cb3-68887fd11afb tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:35.470963 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-49e4150a-b59f-41f1-8cb3-68887fd11afb tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:35.606642 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-49e4150a-b59f-41f1-8cb3-68887fd11afb tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fc916f852f4433eac4a3a2a12384834', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f20791fa785649cfa5df1f60df84dbdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:35.614605 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-49e4150a-b59f-41f1-8cb3-68887fd11afb tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee" status: 200 len: 1522 microversion: 2.1 time: 0.157320 Jun 22 10:28:35.615182 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 349/721] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:35 2022] GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:28:36.107654 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-c0a481ad-7052-4b5b-9140-1ea1bc519cc7 req-ce7e4a5a-4eb1-4331-9784-5c26f0e8c546 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "739e9dbf-4ccc-4022-83e4-d2f4c36955ee", "name": "network-vif-deleted", "tag": "66ed55a7-8e67-4d46-9b13-c7875b6be0f5"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:28:36.119672 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-c0a481ad-7052-4b5b-9140-1ea1bc519cc7 req-ce7e4a5a-4eb1-4331-9784-5c26f0e8c546 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:36.120405 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-c0a481ad-7052-4b5b-9140-1ea1bc519cc7 req-ce7e4a5a-4eb1-4331-9784-5c26f0e8c546 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:36.135645 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-c0a481ad-7052-4b5b-9140-1ea1bc519cc7 req-ce7e4a5a-4eb1-4331-9784-5c26f0e8c546 service nova] Creating event network-vif-deleted:66ed55a7-8e67-4d46-9b13-c7875b6be0f5 for instance 739e9dbf-4ccc-4022-83e4-d2f4c36955ee on hv-cinder-84713 Jun 22 10:28:36.141598 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-c0a481ad-7052-4b5b-9140-1ea1bc519cc7 req-ce7e4a5a-4eb1-4331-9784-5c26f0e8c546 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038453 Jun 22 10:28:36.142318 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 373/722] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:28:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:28:36.363504 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-2ae4f6b1-0ee7-4ddd-965a-b2ececf5a0e8 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:36.364561 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-2ae4f6b1-0ee7-4ddd-965a-b2ececf5a0e8 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: da28df11-c078-43d5-81c4-e78ccf9f6504] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:36.371492 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2ae4f6b1-0ee7-4ddd-965a-b2ececf5a0e8 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:36.371946 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2ae4f6b1-0ee7-4ddd-965a-b2ececf5a0e8 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:36.372711 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2ae4f6b1-0ee7-4ddd-965a-b2ececf5a0e8 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:36.373171 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2ae4f6b1-0ee7-4ddd-965a-b2ececf5a0e8 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:36.405428 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-2ae4f6b1-0ee7-4ddd-965a-b2ececf5a0e8 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045882 Jun 22 10:28:36.406013 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 350/723] 10.222.0.66 () {58 vars in 1301 bytes} [Wed Jun 22 10:28:36 2022] GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 22 10:28:36.481288 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-ec4460a4-da27-49c5-926b-b4bfc8dc32a5 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:36.482158 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-ec4460a4-da27-49c5-926b-b4bfc8dc32a5 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: da28df11-c078-43d5-81c4-e78ccf9f6504] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:36.492265 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ec4460a4-da27-49c5-926b-b4bfc8dc32a5 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:36.492766 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ec4460a4-da27-49c5-926b-b4bfc8dc32a5 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:36.493604 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ec4460a4-da27-49c5-926b-b4bfc8dc32a5 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:36.494080 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ec4460a4-da27-49c5-926b-b4bfc8dc32a5 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:36.544616 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-ec4460a4-da27-49c5-926b-b4bfc8dc32a5 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: da28df11-c078-43d5-81c4-e78ccf9f6504] Going to try to terminate instance {{(pid=117680) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 10:28:36.635048 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-13617f37-1610-4a65-81b3-78bc24513b95 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:36.636045 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-13617f37-1610-4a65-81b3-78bc24513b95 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] [instance: 739e9dbf-4ccc-4022-83e4-d2f4c36955ee] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:36.647199 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-13617f37-1610-4a65-81b3-78bc24513b95 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:36.657754 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-13617f37-1610-4a65-81b3-78bc24513b95 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:36.665234 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-13617f37-1610-4a65-81b3-78bc24513b95 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:36.666416 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-13617f37-1610-4a65-81b3-78bc24513b95 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:36.673784 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-ec4460a4-da27-49c5-926b-b4bfc8dc32a5 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "DELETE /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504" status: 204 len: 0 microversion: 2.1 time: 0.199747 Jun 22 10:28:36.675156 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 374/724] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Jun 22 10:28:36 2022] DELETE /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 10:28:36.688262 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.wsgi [None req-13617f37-1610-4a65-81b3-78bc24513b95 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] HTTP exception thrown: Instance 739e9dbf-4ccc-4022-83e4-d2f4c36955ee could not be found. Jun 22 10:28:36.688615 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-7100e0a4-14c6-4920-bbf5-3ce0bef4809e tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:36.689238 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-7100e0a4-14c6-4920-bbf5-3ce0bef4809e tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: da28df11-c078-43d5-81c4-e78ccf9f6504] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:36.690086 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-13617f37-1610-4a65-81b3-78bc24513b95 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Request method failure captured: Jun 22 10:28:36.690086 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: request: GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee HTTP/1.1 Jun 22 10:28:36.690086 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Accept: application/json Jun 22 10:28:36.690086 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Accept-Encoding: identity Jun 22 10:28:36.690086 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Connection: close Jun 22 10:28:36.690086 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Content-Length: 0 Jun 22 10:28:36.690086 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Content-Type: application/json Jun 22 10:28:36.690086 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Host: 10.222.0.66 Jun 22 10:28:36.690086 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Openstack-System-Scope: None Jun 22 10:28:36.690086 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: User-Agent: python-urllib3/1.26.9 Jun 22 10:28:36.690086 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Auth-Token: gAAAAABisu0KTX4LByDrs2wd0wf7QkjgZCYL58jTaGKxU6GloV6S5vTA8f4YmIXgHT_KMAgKu1jdsn-8Uga7Qnln7YVuKutNjZ4Xn3tAFNoo7zG8SK5VuNoRcwHUn_V5P08hyf2Bosoz8F0t6BB7YpwwfdbxZ3fftIbWEfVknGZuJ2vKr7E2QFU Jun 22 10:28:36.690086 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Domain-Id: None Jun 22 10:28:36.690086 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Domain-Name: None Jun 22 10:28:36.690086 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Identity-Status: Confirmed Jun 22 10:28:36.690086 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Is-Admin-Project: True Jun 22 10:28:36.690086 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Domain-Id: default Jun 22 10:28:36.690086 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Domain-Name: Default Jun 22 10:28:36.690086 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Id: f20791fa785649cfa5df1f60df84dbdb Jun 22 10:28:36.690086 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2082763206 Jun 22 10:28:36.690086 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Role: member,reader Jun 22 10:28:36.690086 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Roles: member,reader Jun 22 10:28:36.691489 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f20791fa785649cfa5df1f60df84dbdb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f20791fa785649cfa5df1f60df84dbdb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f20791fa785649cfa5df1f60df84dbdb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f20791fa785649cfa5df1f60df84dbdb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}] Jun 22 10:28:36.691489 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2082763206 Jun 22 10:28:36.691489 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Tenant-Id: f20791fa785649cfa5df1f60df84dbdb Jun 22 10:28:36.691489 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2082763206 Jun 22 10:28:36.691489 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User: tempest-ServerRescueNegativeTestJSON-2082763206-project Jun 22 10:28:36.691489 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Domain-Id: default Jun 22 10:28:36.691489 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Domain-Name: Default Jun 22 10:28:36.691489 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Id: 8fc916f852f4433eac4a3a2a12384834 Jun 22 10:28:36.691489 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2082763206-project Jun 22 10:28:36.691489 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: method: > Jun 22 10:28:36.691489 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: exception: Instance 739e9dbf-4ccc-4022-83e4-d2f4c36955ee could not be found. Jun 22 10:28:36.691489 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: action_args: {'id': '739e9dbf-4ccc-4022-83e4-d2f4c36955ee'} Jun 22 10:28:36.692327 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:28:36.692327 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:28:36.692327 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:28:36.692327 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:28:36.692327 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:28:36.692327 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:28:36.692327 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:28:36.692327 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:28:36.692327 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:28:36.692327 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:28:36.692327 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 739e9dbf-4ccc-4022-83e4-d2f4c36955ee could not be found. Jun 22 10:28:36.692327 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:28:36.692327 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:28:36.692327 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:28:36.692327 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:28:36.692327 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:28:36.692327 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:28:36.692327 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:28:36.692327 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:28:36.692327 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:28:36.693610 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:28:36.693610 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:28:36.693610 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:28:36.693610 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:28:36.693610 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:28:36.693610 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:28:36.693610 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:28:36.693610 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 739e9dbf-4ccc-4022-83e4-d2f4c36955ee could not be found. Jun 22 10:28:36.693610 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:28:36.693610 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:28:36.693610 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:28:36.693610 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:28:36.693610 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:28:36.693610 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:28:36.693610 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:28:36.693610 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:28:36.693610 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 739e9dbf-4ccc-4022-83e4-d2f4c36955ee could not be found. Jun 22 10:28:36.693610 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:28:36.695408 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-13617f37-1610-4a65-81b3-78bc24513b95 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] Returning 404 to user: Instance 739e9dbf-4ccc-4022-83e4-d2f4c36955ee could not be found. {{(pid=117679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:28:36.695408 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-13617f37-1610-4a65-81b3-78bc24513b95 tempest-ServerRescueNegativeTestJSON-2082763206 tempest-ServerRescueNegativeTestJSON-2082763206-project] 10.222.0.66 "GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee" status: 404 len: 111 microversion: 2.1 time: 0.063093 Jun 22 10:28:36.695408 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 351/725] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:36 2022] GET /compute/v2.1/servers/739e9dbf-4ccc-4022-83e4-d2f4c36955ee => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 22 10:28:36.701320 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7100e0a4-14c6-4920-bbf5-3ce0bef4809e tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:36.701847 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7100e0a4-14c6-4920-bbf5-3ce0bef4809e tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:36.702905 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7100e0a4-14c6-4920-bbf5-3ce0bef4809e tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:36.703406 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7100e0a4-14c6-4920-bbf5-3ce0bef4809e tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:36.709286 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:28:36.865463 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-7100e0a4-14c6-4920-bbf5-3ce0bef4809e tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:36.878915 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-7100e0a4-14c6-4920-bbf5-3ce0bef4809e tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504" status: 200 len: 1674 microversion: 2.1 time: 0.195326 Jun 22 10:28:36.880420 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 375/726] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:36 2022] GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504 => generated 1674 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:28:37.903241 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-0ba8507b-fd51-43a2-94cf-503c9f2c4648 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:37.904329 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-0ba8507b-fd51-43a2-94cf-503c9f2c4648 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: da28df11-c078-43d5-81c4-e78ccf9f6504] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:37.917625 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0ba8507b-fd51-43a2-94cf-503c9f2c4648 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:37.918435 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0ba8507b-fd51-43a2-94cf-503c9f2c4648 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:37.919913 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0ba8507b-fd51-43a2-94cf-503c9f2c4648 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:37.920716 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0ba8507b-fd51-43a2-94cf-503c9f2c4648 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:38.237311 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-0ba8507b-fd51-43a2-94cf-503c9f2c4648 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:38.253350 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-0ba8507b-fd51-43a2-94cf-503c9f2c4648 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504" status: 200 len: 1674 microversion: 2.1 time: 0.357521 Jun 22 10:28:38.253947 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 352/727] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:37 2022] GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504 => generated 1674 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:28:39.161111 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-205c49cb-a453-4141-9b8b-f7e818622a30 req-cb3da85e-cdf2-4157-9931-15ef499de2a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da28df11-c078-43d5-81c4-e78ccf9f6504", "name": "network-vif-deleted", "tag": "937e9931-d784-4d24-8619-009399b6a8d5"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:28:39.175266 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-205c49cb-a453-4141-9b8b-f7e818622a30 req-cb3da85e-cdf2-4157-9931-15ef499de2a5 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:39.176770 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-205c49cb-a453-4141-9b8b-f7e818622a30 req-cb3da85e-cdf2-4157-9931-15ef499de2a5 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:39.214573 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-205c49cb-a453-4141-9b8b-f7e818622a30 req-cb3da85e-cdf2-4157-9931-15ef499de2a5 service nova] Creating event network-vif-deleted:937e9931-d784-4d24-8619-009399b6a8d5 for instance da28df11-c078-43d5-81c4-e78ccf9f6504 on hv-cinder-84713 Jun 22 10:28:39.223537 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-205c49cb-a453-4141-9b8b-f7e818622a30 req-cb3da85e-cdf2-4157-9931-15ef499de2a5 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068116 Jun 22 10:28:39.230274 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 376/728] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:28:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:28:39.282966 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-20d42fe2-f448-4f47-a652-8d29f36268fe tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:39.284889 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-20d42fe2-f448-4f47-a652-8d29f36268fe tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: da28df11-c078-43d5-81c4-e78ccf9f6504] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:39.316830 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-20d42fe2-f448-4f47-a652-8d29f36268fe tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:39.319941 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-20d42fe2-f448-4f47-a652-8d29f36268fe tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:39.328338 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-20d42fe2-f448-4f47-a652-8d29f36268fe tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:39.329642 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-20d42fe2-f448-4f47-a652-8d29f36268fe tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:39.425045 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-20d42fe2-f448-4f47-a652-8d29f36268fe tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:39.426293 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-20d42fe2-f448-4f47-a652-8d29f36268fe tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:39.427108 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.objects.instance [None req-20d42fe2-f448-4f47-a652-8d29f36268fe tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lazy-loading 'fault' on Instance uuid da28df11-c078-43d5-81c4-e78ccf9f6504 {{(pid=117679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:28:39.563528 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-20d42fe2-f448-4f47-a652-8d29f36268fe tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:39.585472 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-20d42fe2-f448-4f47-a652-8d29f36268fe tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504" status: 200 len: 1328 microversion: 2.1 time: 0.310218 Jun 22 10:28:39.586581 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 353/729] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:39 2022] GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504 => generated 1328 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:28:40.608543 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-ea394c89-958c-411f-81e9-12503b6b9276 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:40.609953 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-ea394c89-958c-411f-81e9-12503b6b9276 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: da28df11-c078-43d5-81c4-e78ccf9f6504] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:40.627505 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ea394c89-958c-411f-81e9-12503b6b9276 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:40.628357 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ea394c89-958c-411f-81e9-12503b6b9276 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:40.629483 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ea394c89-958c-411f-81e9-12503b6b9276 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:40.630139 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ea394c89-958c-411f-81e9-12503b6b9276 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:40.655638 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.wsgi [None req-ea394c89-958c-411f-81e9-12503b6b9276 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] HTTP exception thrown: Instance da28df11-c078-43d5-81c4-e78ccf9f6504 could not be found. Jun 22 10:28:40.657512 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-ea394c89-958c-411f-81e9-12503b6b9276 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Request method failure captured: Jun 22 10:28:40.657512 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: request: GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504 HTTP/1.1 Jun 22 10:28:40.657512 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Accept: application/json Jun 22 10:28:40.657512 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Accept-Encoding: identity Jun 22 10:28:40.657512 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Connection: close Jun 22 10:28:40.657512 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Content-Length: 0 Jun 22 10:28:40.657512 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Content-Type: application/json Jun 22 10:28:40.657512 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Host: 10.222.0.66 Jun 22 10:28:40.657512 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Openstack-System-Scope: None Jun 22 10:28:40.657512 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: User-Agent: python-urllib3/1.26.9 Jun 22 10:28:40.657512 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Auth-Token: gAAAAABisu0BnE_6QJsexpU7NTJiv_Hqc8o3PmmQ7QZO72blyC_knl60ZrRuGijGZKHl9RR5uw4zHVvsp88mzHQfFz3yJPSm3wXa4GqXjc6Bzt_tqISAmWw_LHmOpybPJrtZUCxW67BMwQK-TIX_sxqI_elHLkYwKszKeVwHg9aHgSGQXB6cYVM Jun 22 10:28:40.657512 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Domain-Id: None Jun 22 10:28:40.657512 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Domain-Name: None Jun 22 10:28:40.657512 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Identity-Status: Confirmed Jun 22 10:28:40.657512 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Is-Admin-Project: True Jun 22 10:28:40.657512 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Domain-Id: default Jun 22 10:28:40.657512 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Domain-Name: Default Jun 22 10:28:40.657512 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Id: fecb66f4a7094cd3963caf460c52b88b Jun 22 10:28:40.657512 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Name: tempest-AttachVolumeTestJSON-986519348 Jun 22 10:28:40.657512 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Role: member,reader Jun 22 10:28:40.657512 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Roles: member,reader Jun 22 10:28:40.659266 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_fecb66f4a7094cd3963caf460c52b88b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/fecb66f4a7094cd3963caf460c52b88b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/fecb66f4a7094cd3963caf460c52b88b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/fecb66f4a7094cd3963caf460c52b88b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}] Jun 22 10:28:40.659266 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant: tempest-AttachVolumeTestJSON-986519348 Jun 22 10:28:40.659266 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant-Id: fecb66f4a7094cd3963caf460c52b88b Jun 22 10:28:40.659266 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant-Name: tempest-AttachVolumeTestJSON-986519348 Jun 22 10:28:40.659266 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User: tempest-AttachVolumeTestJSON-986519348-project Jun 22 10:28:40.659266 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Domain-Id: default Jun 22 10:28:40.659266 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Domain-Name: Default Jun 22 10:28:40.659266 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Id: 595531abf958489795f2363026697a5b Jun 22 10:28:40.659266 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Name: tempest-AttachVolumeTestJSON-986519348-project Jun 22 10:28:40.659266 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: method: > Jun 22 10:28:40.659266 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: exception: Instance da28df11-c078-43d5-81c4-e78ccf9f6504 could not be found. Jun 22 10:28:40.659266 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: action_args: {'id': 'da28df11-c078-43d5-81c4-e78ccf9f6504'} Jun 22 10:28:40.660238 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:28:40.660238 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:28:40.660238 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:28:40.660238 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:28:40.660238 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:28:40.660238 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:28:40.660238 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:28:40.660238 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:28:40.660238 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:28:40.660238 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:28:40.660238 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da28df11-c078-43d5-81c4-e78ccf9f6504 could not be found. Jun 22 10:28:40.660238 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:28:40.660238 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:28:40.660238 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:28:40.660238 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:28:40.660238 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:28:40.660238 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:28:40.660238 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:28:40.660238 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:28:40.660238 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:28:40.661926 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:28:40.661926 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:28:40.661926 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:28:40.661926 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:28:40.661926 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:28:40.661926 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:28:40.661926 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:28:40.661926 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da28df11-c078-43d5-81c4-e78ccf9f6504 could not be found. Jun 22 10:28:40.661926 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:28:40.661926 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:28:40.661926 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:28:40.661926 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:28:40.661926 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:28:40.661926 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:28:40.661926 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:28:40.661926 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:28:40.661926 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da28df11-c078-43d5-81c4-e78ccf9f6504 could not be found. Jun 22 10:28:40.661926 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:28:40.664343 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-ea394c89-958c-411f-81e9-12503b6b9276 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Returning 404 to user: Instance da28df11-c078-43d5-81c4-e78ccf9f6504 could not be found. {{(pid=117680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:28:40.665415 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-ea394c89-958c-411f-81e9-12503b6b9276 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504" status: 404 len: 111 microversion: 2.1 time: 0.065183 Jun 22 10:28:40.666540 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 377/730] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:40 2022] GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 22 10:28:40.675983 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-f3a5692a-0718-4e2f-a78c-8e2b8bbaff4e tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '.version_select at 0x7f60d9f02280>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:40.701437 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-f3a5692a-0718-4e2f-a78c-8e2b8bbaff4e tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1166184984" status: 202 len: 0 microversion: 2.1 time: 0.030460 Jun 22 10:28:40.702602 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 354/731] 10.222.0.66 () {58 vars in 1220 bytes} [Wed Jun 22 10:28:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1166184984 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:28:41.646998 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-a4204413-2b41-4498-8170-e356f48d358a tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Action: 'create', calling method: .version_select at 0x7f60d9700e50>, body: {"keypair": {"name": "tempest-keypair-144009232", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5dZgiq5/uEh5KEl++NoJw9RaL+sUUd61jh94p1miHwT5QteBC3/S97FLbXngl2/gEzaaNoD6td9m+wrLgFQz3ynAiJPORZlJyf6oNZqHerpRGxkeFljNxxMOXFDPtgQQ=="}} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:28:41.665725 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.quota [None req-a4204413-2b41-4498-8170-e356f48d358a tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Getting quotas for project fecb66f4a7094cd3963caf460c52b88b. Resources: {'key_pairs'} {{(pid=117680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:28:41.670435 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.quota [None req-a4204413-2b41-4498-8170-e356f48d358a tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Getting quotas for user 595531abf958489795f2363026697a5b and project fecb66f4a7094cd3963caf460c52b88b. Resources: {'key_pairs'} {{(pid=117680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:28:41.696737 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-a4204413-2b41-4498-8170-e356f48d358a tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.053223 Jun 22 10:28:41.697710 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 378/732] 10.222.0.66 () {60 vars in 1158 bytes} [Wed Jun 22 10:28:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:28:42.989158 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-d8756ab2-be7c-413f-9a53-cdada84c1907 tempest-VolumesSnapshotsTestJSON-707916068 tempest-VolumesSnapshotsTestJSON-707916068-project] Action: 'create', calling method: .version_select at 0x7f60da063ee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-184537667"}} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:28:43.276775 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-4523d7dc-4abd-4009-a62c-cb950fcdb978 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-797847859", "imageRef": "58addf50-5317-403a-beb0-4760bdbcaa13", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8736b376-7b84-42a2-ac98-e61548881245"}], "security_groups": [{"name": "tempest-securitygroup--1432835766"}], "key_name": "tempest-keypair-144009232", "user_data": "}} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:28:43.372872 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-d8756ab2-be7c-413f-9a53-cdada84c1907 tempest-VolumesSnapshotsTestJSON-707916068 tempest-VolumesSnapshotsTestJSON-707916068-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.535558 Jun 22 10:28:43.374596 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 355/733] 10.222.0.66 () {60 vars in 1154 bytes} [Wed Jun 22 10:28:42 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 539 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 22 10:28:43.393041 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-3a3ad863-2b7e-4a48-8045-78f73b6c3edd tempest-VolumesSnapshotsTestJSON-707916068 tempest-VolumesSnapshotsTestJSON-707916068-project] Calling method '.version_select at 0x7f60da04eaf0>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:43.409011 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.network.neutron [None req-4523d7dc-4abd-4009-a62c-cb950fcdb978 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] validate_networks() for [('8736b376-7b84-42a2-ac98-e61548881245', None, None, None, None, None)] {{(pid=117680) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 10:28:43.467027 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-3a3ad863-2b7e-4a48-8045-78f73b6c3edd tempest-VolumesSnapshotsTestJSON-707916068 tempest-VolumesSnapshotsTestJSON-707916068-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/96c54b16-6841-4e3e-b2e1-e9e13c571058" status: 200 len: 344 microversion: 2.1 time: 0.081992 Jun 22 10:28:43.467712 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 356/734] 10.222.0.66 () {58 vars in 1244 bytes} [Wed Jun 22 10:28:43 2022] GET /compute/v2.1/os-volumes/96c54b16-6841-4e3e-b2e1-e9e13c571058 => generated 344 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:28:44.244303 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-4523d7dc-4abd-4009-a62c-cb950fcdb978 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Flavor limits 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 10:28:44.244797 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-4523d7dc-4abd-4009-a62c-cb950fcdb978 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Image limits 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 10:28:44.245283 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-4523d7dc-4abd-4009-a62c-cb950fcdb978 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Flavor pref 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 10:28:44.245696 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-4523d7dc-4abd-4009-a62c-cb950fcdb978 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Image pref 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 10:28:44.246146 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-4523d7dc-4abd-4009-a62c-cb950fcdb978 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 10:28:44.260539 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4523d7dc-4abd-4009-a62c-cb950fcdb978 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:44.261325 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4523d7dc-4abd-4009-a62c-cb950fcdb978 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:44.262862 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4523d7dc-4abd-4009-a62c-cb950fcdb978 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:44.263622 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4523d7dc-4abd-4009-a62c-cb950fcdb978 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:44.296426 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.quota [None req-4523d7dc-4abd-4009-a62c-cb950fcdb978 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Getting quotas for project fecb66f4a7094cd3963caf460c52b88b. Resources: {'instances', 'cores', 'ram'} {{(pid=117680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:28:44.304161 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.quota [None req-4523d7dc-4abd-4009-a62c-cb950fcdb978 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Getting quotas for user 595531abf958489795f2363026697a5b and project fecb66f4a7094cd3963caf460c52b88b. Resources: {'instances', 'cores', 'ram'} {{(pid=117680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:28:44.325195 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-4523d7dc-4abd-4009-a62c-cb950fcdb978 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Going to run 1 instances... {{(pid=117680) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 10:28:44.329331 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-4523d7dc-4abd-4009-a62c-cb950fcdb978 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: a1520a14-618c-4e2d-b20d-a08ebd9f6daa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58addf50-5317-403a-beb0-4760bdbcaa13',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 10:28:44.406291 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-4523d7dc-4abd-4009-a62c-cb950fcdb978 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.136609 Jun 22 10:28:44.406998 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 379/735] 10.222.0.66 () {60 vars in 1146 bytes} [Wed Jun 22 10:28:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 1138 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 22 10:28:44.418517 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-6e2abf07-f2f7-48b7-94ff-a3abcf9cf7a2 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:44.419363 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-6e2abf07-f2f7-48b7-94ff-a3abcf9cf7a2 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: a1520a14-618c-4e2d-b20d-a08ebd9f6daa] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:44.481025 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-c29003ee-dc3d-4f2c-95f6-76812a5c0a05 tempest-VolumesSnapshotsTestJSON-707916068 tempest-VolumesSnapshotsTestJSON-707916068-project] Calling method '.version_select at 0x7f60d97738b0>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:44.500060 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-6e2abf07-f2f7-48b7-94ff-a3abcf9cf7a2 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:44.514293 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-6e2abf07-f2f7-48b7-94ff-a3abcf9cf7a2 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa" status: 200 len: 1236 microversion: 2.1 time: 0.099949 Jun 22 10:28:44.515344 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 357/736] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:44 2022] GET /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa => generated 1236 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:28:44.543639 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-c29003ee-dc3d-4f2c-95f6-76812a5c0a05 tempest-VolumesSnapshotsTestJSON-707916068 tempest-VolumesSnapshotsTestJSON-707916068-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/96c54b16-6841-4e3e-b2e1-e9e13c571058" status: 200 len: 345 microversion: 2.1 time: 0.066120 Jun 22 10:28:44.544729 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 380/737] 10.222.0.66 () {58 vars in 1244 bytes} [Wed Jun 22 10:28:44 2022] GET /compute/v2.1/os-volumes/96c54b16-6841-4e3e-b2e1-e9e13c571058 => generated 345 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:28:44.561787 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-04a90306-100d-4a4b-a4ce-a197e94548d6 tempest-VolumesSnapshotsTestJSON-707916068 tempest-VolumesSnapshotsTestJSON-707916068-project] Action: 'create', calling method: .version_select at 0x7f60d9ef6c10>, body: {"snapshot": {"volume_id": "96c54b16-6841-4e3e-b2e1-e9e13c571058", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1866688072"}} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:28:44.808724 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-04a90306-100d-4a4b-a4ce-a197e94548d6 tempest-VolumesSnapshotsTestJSON-707916068 tempest-VolumesSnapshotsTestJSON-707916068-project] 10.222.0.66 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.251415 Jun 22 10:28:44.813661 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 358/738] 10.222.0.66 () {60 vars in 1161 bytes} [Wed Jun 22 10:28:44 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:28:44.825509 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-375c27f0-aa8c-4400-8aa3-f1140446f175 tempest-VolumesSnapshotsTestJSON-707916068 tempest-VolumesSnapshotsTestJSON-707916068-project] Calling method '.version_select at 0x7f60d9700d30>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:44.876844 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-375c27f0-aa8c-4400-8aa3-f1140446f175 tempest-VolumesSnapshotsTestJSON-707916068 tempest-VolumesSnapshotsTestJSON-707916068-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/e6a4a5ce-7688-4a49-afb5-af5f442cb007" status: 200 len: 287 microversion: 2.1 time: 0.056528 Jun 22 10:28:44.877742 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 381/739] 10.222.0.66 () {58 vars in 1250 bytes} [Wed Jun 22 10:28:44 2022] GET /compute/v2.1/os-snapshots/e6a4a5ce-7688-4a49-afb5-af5f442cb007 => generated 287 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:28:44.890349 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-226d1ddb-b84a-4164-84be-3e04c2d4ca8d tempest-VolumesSnapshotsTestJSON-707916068 tempest-VolumesSnapshotsTestJSON-707916068-project] Calling method '.version_select at 0x7f60d9fa4f70>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:44.930694 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-226d1ddb-b84a-4164-84be-3e04c2d4ca8d tempest-VolumesSnapshotsTestJSON-707916068 tempest-VolumesSnapshotsTestJSON-707916068-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.044897 Jun 22 10:28:44.931916 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 359/740] 10.222.0.66 () {58 vars in 1139 bytes} [Wed Jun 22 10:28:44 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:28:44.947914 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-4c80264f-41fb-422e-a67c-e1da3e7fb948 tempest-VolumesSnapshotsTestJSON-707916068 tempest-VolumesSnapshotsTestJSON-707916068-project] Calling method '.version_select at 0x7f60d99993a0>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:44.991780 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-4c80264f-41fb-422e-a67c-e1da3e7fb948 tempest-VolumesSnapshotsTestJSON-707916068 tempest-VolumesSnapshotsTestJSON-707916068-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/e6a4a5ce-7688-4a49-afb5-af5f442cb007" status: 200 len: 287 microversion: 2.1 time: 0.051274 Jun 22 10:28:44.992336 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 382/741] 10.222.0.66 () {58 vars in 1250 bytes} [Wed Jun 22 10:28:44 2022] GET /compute/v2.1/os-snapshots/e6a4a5ce-7688-4a49-afb5-af5f442cb007 => generated 287 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:28:45.533829 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-b0d565f6-5b82-49da-8bdc-7159bb056b48 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:45.534431 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-b0d565f6-5b82-49da-8bdc-7159bb056b48 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: a1520a14-618c-4e2d-b20d-a08ebd9f6daa] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:45.541972 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b0d565f6-5b82-49da-8bdc-7159bb056b48 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:45.542418 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b0d565f6-5b82-49da-8bdc-7159bb056b48 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:45.543250 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b0d565f6-5b82-49da-8bdc-7159bb056b48 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:45.543676 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b0d565f6-5b82-49da-8bdc-7159bb056b48 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:45.618951 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-b0d565f6-5b82-49da-8bdc-7159bb056b48 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:45.627599 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-b0d565f6-5b82-49da-8bdc-7159bb056b48 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa" status: 200 len: 1296 microversion: 2.1 time: 0.098126 Jun 22 10:28:45.628210 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 360/742] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:45 2022] GET /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa => generated 1296 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:28:46.005160 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-3bd6bfe5-cae5-4504-a339-ec9ec35aa955 tempest-VolumesSnapshotsTestJSON-707916068 tempest-VolumesSnapshotsTestJSON-707916068-project] Calling method '.version_select at 0x7f60d9773a60>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:46.039914 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-3bd6bfe5-cae5-4504-a339-ec9ec35aa955 tempest-VolumesSnapshotsTestJSON-707916068 tempest-VolumesSnapshotsTestJSON-707916068-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/e6a4a5ce-7688-4a49-afb5-af5f442cb007" status: 200 len: 287 microversion: 2.1 time: 0.039268 Jun 22 10:28:46.040910 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 383/743] 10.222.0.66 () {58 vars in 1250 bytes} [Wed Jun 22 10:28:45 2022] GET /compute/v2.1/os-snapshots/e6a4a5ce-7688-4a49-afb5-af5f442cb007 => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:28:46.646544 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-feff0116-df00-4d5b-a40c-8d1dfd63dca6 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:46.647270 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-feff0116-df00-4d5b-a40c-8d1dfd63dca6 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: a1520a14-618c-4e2d-b20d-a08ebd9f6daa] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:46.654858 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-feff0116-df00-4d5b-a40c-8d1dfd63dca6 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:46.655315 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-feff0116-df00-4d5b-a40c-8d1dfd63dca6 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:46.656098 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-feff0116-df00-4d5b-a40c-8d1dfd63dca6 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:46.656533 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-feff0116-df00-4d5b-a40c-8d1dfd63dca6 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:46.724291 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-feff0116-df00-4d5b-a40c-8d1dfd63dca6 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:46.732639 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-feff0116-df00-4d5b-a40c-8d1dfd63dca6 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa" status: 200 len: 1296 microversion: 2.1 time: 0.090478 Jun 22 10:28:46.733629 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 361/744] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:46 2022] GET /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa => generated 1296 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:28:47.058642 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-df1f9829-18f4-4e1d-9902-5af748e215b6 tempest-VolumesSnapshotsTestJSON-707916068 tempest-VolumesSnapshotsTestJSON-707916068-project] Calling method '.version_select at 0x7f60d9747310>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:47.096906 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-df1f9829-18f4-4e1d-9902-5af748e215b6 tempest-VolumesSnapshotsTestJSON-707916068 tempest-VolumesSnapshotsTestJSON-707916068-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/e6a4a5ce-7688-4a49-afb5-af5f442cb007" status: 200 len: 287 microversion: 2.1 time: 0.045779 Jun 22 10:28:47.097581 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 384/745] 10.222.0.66 () {58 vars in 1250 bytes} [Wed Jun 22 10:28:47 2022] GET /compute/v2.1/os-snapshots/e6a4a5ce-7688-4a49-afb5-af5f442cb007 => generated 287 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:28:47.751695 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-613f9c44-59a4-4303-99e5-3d0ea176b193 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:47.752334 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-613f9c44-59a4-4303-99e5-3d0ea176b193 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: a1520a14-618c-4e2d-b20d-a08ebd9f6daa] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:47.759832 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-613f9c44-59a4-4303-99e5-3d0ea176b193 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:47.760355 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-613f9c44-59a4-4303-99e5-3d0ea176b193 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:47.761273 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-613f9c44-59a4-4303-99e5-3d0ea176b193 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:47.761816 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-613f9c44-59a4-4303-99e5-3d0ea176b193 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:47.830163 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-613f9c44-59a4-4303-99e5-3d0ea176b193 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:47.838239 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-613f9c44-59a4-4303-99e5-3d0ea176b193 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa" status: 200 len: 1306 microversion: 2.1 time: 0.091070 Jun 22 10:28:47.838912 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 362/746] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:47 2022] GET /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa => generated 1306 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:28:48.110844 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-8f520a49-b13d-498f-a227-f0bed208d653 tempest-VolumesSnapshotsTestJSON-707916068 tempest-VolumesSnapshotsTestJSON-707916068-project] Calling method '.version_select at 0x7f60d96b09d0>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:48.145376 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-8f520a49-b13d-498f-a227-f0bed208d653 tempest-VolumesSnapshotsTestJSON-707916068 tempest-VolumesSnapshotsTestJSON-707916068-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/e6a4a5ce-7688-4a49-afb5-af5f442cb007" status: 200 len: 287 microversion: 2.1 time: 0.039536 Jun 22 10:28:48.145939 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 385/747] 10.222.0.66 () {58 vars in 1250 bytes} [Wed Jun 22 10:28:48 2022] GET /compute/v2.1/os-snapshots/e6a4a5ce-7688-4a49-afb5-af5f442cb007 => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:28:48.864087 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-7d4e7a95-b78f-4907-9dbb-de49724f2632 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:48.864770 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-7d4e7a95-b78f-4907-9dbb-de49724f2632 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: a1520a14-618c-4e2d-b20d-a08ebd9f6daa] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:48.872090 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7d4e7a95-b78f-4907-9dbb-de49724f2632 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:48.872545 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7d4e7a95-b78f-4907-9dbb-de49724f2632 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:48.873343 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7d4e7a95-b78f-4907-9dbb-de49724f2632 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:48.873783 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7d4e7a95-b78f-4907-9dbb-de49724f2632 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:48.943084 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-7d4e7a95-b78f-4907-9dbb-de49724f2632 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:48.951178 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-7d4e7a95-b78f-4907-9dbb-de49724f2632 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa" status: 200 len: 1306 microversion: 2.1 time: 0.091048 Jun 22 10:28:48.951780 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 363/748] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:48 2022] GET /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa => generated 1306 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:28:49.158524 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-adfef556-3106-4bc8-97f0-084b0eb76d51 tempest-VolumesSnapshotsTestJSON-707916068 tempest-VolumesSnapshotsTestJSON-707916068-project] Calling method '.version_select at 0x7f60d97473a0>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:49.192042 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-adfef556-3106-4bc8-97f0-084b0eb76d51 tempest-VolumesSnapshotsTestJSON-707916068 tempest-VolumesSnapshotsTestJSON-707916068-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/e6a4a5ce-7688-4a49-afb5-af5f442cb007" status: 200 len: 287 microversion: 2.1 time: 0.037832 Jun 22 10:28:49.196686 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 386/749] 10.222.0.66 () {58 vars in 1250 bytes} [Wed Jun 22 10:28:49 2022] GET /compute/v2.1/os-snapshots/e6a4a5ce-7688-4a49-afb5-af5f442cb007 => generated 287 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:28:49.975065 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-a1749a05-ffc9-4cc5-a343-52623dfae808 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:49.976084 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-a1749a05-ffc9-4cc5-a343-52623dfae808 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: a1520a14-618c-4e2d-b20d-a08ebd9f6daa] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:49.986586 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a1749a05-ffc9-4cc5-a343-52623dfae808 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:49.987714 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a1749a05-ffc9-4cc5-a343-52623dfae808 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:49.989026 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a1749a05-ffc9-4cc5-a343-52623dfae808 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:49.989659 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a1749a05-ffc9-4cc5-a343-52623dfae808 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:50.207124 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-85f72adb-039c-4f61-a4bc-70c01ac1221d tempest-VolumesSnapshotsTestJSON-707916068 tempest-VolumesSnapshotsTestJSON-707916068-project] Calling method '.version_select at 0x7f60d97739d0>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:50.246352 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-85f72adb-039c-4f61-a4bc-70c01ac1221d tempest-VolumesSnapshotsTestJSON-707916068 tempest-VolumesSnapshotsTestJSON-707916068-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/e6a4a5ce-7688-4a49-afb5-af5f442cb007" status: 200 len: 288 microversion: 2.1 time: 0.045122 Jun 22 10:28:50.247156 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 387/750] 10.222.0.66 () {58 vars in 1250 bytes} [Wed Jun 22 10:28:50 2022] GET /compute/v2.1/os-snapshots/e6a4a5ce-7688-4a49-afb5-af5f442cb007 => generated 288 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:28:50.250795 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-a1749a05-ffc9-4cc5-a343-52623dfae808 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:50.261627 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-a1749a05-ffc9-4cc5-a343-52623dfae808 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa" status: 200 len: 1362 microversion: 2.1 time: 0.295758 Jun 22 10:28:50.262557 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 364/751] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:49 2022] GET /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa => generated 1362 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:28:50.265610 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-3638a3e8-227f-44f3-9aee-c3286b122f92 tempest-VolumesSnapshotsTestJSON-707916068 tempest-VolumesSnapshotsTestJSON-707916068-project] Calling method '.version_select at 0x7f60d98c3670>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:50.338136 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-3638a3e8-227f-44f3-9aee-c3286b122f92 tempest-VolumesSnapshotsTestJSON-707916068 tempest-VolumesSnapshotsTestJSON-707916068-project] 10.222.0.66 "DELETE /compute/v2.1/os-snapshots/e6a4a5ce-7688-4a49-afb5-af5f442cb007" status: 202 len: 0 microversion: 2.1 time: 0.080167 Jun 22 10:28:50.339351 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 388/752] 10.222.0.66 () {58 vars in 1253 bytes} [Wed Jun 22 10:28:50 2022] DELETE /compute/v2.1/os-snapshots/e6a4a5ce-7688-4a49-afb5-af5f442cb007 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:28:50.352634 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-8a484152-5d8b-447c-bbc2-5d9089618657 tempest-VolumesSnapshotsTestJSON-707916068 tempest-VolumesSnapshotsTestJSON-707916068-project] Calling method '.version_select at 0x7f60d9f43790>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:50.391496 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-8a484152-5d8b-447c-bbc2-5d9089618657 tempest-VolumesSnapshotsTestJSON-707916068 tempest-VolumesSnapshotsTestJSON-707916068-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/e6a4a5ce-7688-4a49-afb5-af5f442cb007" status: 200 len: 287 microversion: 2.1 time: 0.045768 Jun 22 10:28:50.392393 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 365/753] 10.222.0.66 () {58 vars in 1250 bytes} [Wed Jun 22 10:28:50 2022] GET /compute/v2.1/os-snapshots/e6a4a5ce-7688-4a49-afb5-af5f442cb007 => generated 287 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:28:50.811835 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-93a53e47-6469-4afa-a8db-41cdc5afd606 req-6d0f1883-0ad7-41ed-8d56-f5031fa56bb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1520a14-618c-4e2d-b20d-a08ebd9f6daa", "tag": "f2855566-99ba-4484-9767-575224b0c7dc"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:28:50.829970 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-93a53e47-6469-4afa-a8db-41cdc5afd606 req-6d0f1883-0ad7-41ed-8d56-f5031fa56bb1 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:50.832598 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-93a53e47-6469-4afa-a8db-41cdc5afd606 req-6d0f1883-0ad7-41ed-8d56-f5031fa56bb1 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:50.855388 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-93a53e47-6469-4afa-a8db-41cdc5afd606 req-6d0f1883-0ad7-41ed-8d56-f5031fa56bb1 service nova] Creating event network-changed:f2855566-99ba-4484-9767-575224b0c7dc for instance a1520a14-618c-4e2d-b20d-a08ebd9f6daa on hv-cinder-84713 Jun 22 10:28:50.863925 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-93a53e47-6469-4afa-a8db-41cdc5afd606 req-6d0f1883-0ad7-41ed-8d56-f5031fa56bb1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065676 Jun 22 10:28:50.864917 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 389/754] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:28:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:28:51.281130 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-43ff7a05-93ff-4614-bd49-81a3c91d2ec0 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:51.281821 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-43ff7a05-93ff-4614-bd49-81a3c91d2ec0 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: a1520a14-618c-4e2d-b20d-a08ebd9f6daa] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:51.289578 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-43ff7a05-93ff-4614-bd49-81a3c91d2ec0 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:51.290299 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-43ff7a05-93ff-4614-bd49-81a3c91d2ec0 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:51.291285 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-43ff7a05-93ff-4614-bd49-81a3c91d2ec0 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:51.291729 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-43ff7a05-93ff-4614-bd49-81a3c91d2ec0 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:51.319884 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:28:51.416908 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-c1710923-7226-45e1-b3b0-afd51b3515a1 tempest-VolumesSnapshotsTestJSON-707916068 tempest-VolumesSnapshotsTestJSON-707916068-project] Calling method '.version_select at 0x7f60d9773940>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:51.471847 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.wsgi [None req-c1710923-7226-45e1-b3b0-afd51b3515a1 tempest-VolumesSnapshotsTestJSON-707916068 tempest-VolumesSnapshotsTestJSON-707916068-project] HTTP exception thrown: Snapshot e6a4a5ce-7688-4a49-afb5-af5f442cb007 could not be found. Jun 22 10:28:51.476509 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-c1710923-7226-45e1-b3b0-afd51b3515a1 tempest-VolumesSnapshotsTestJSON-707916068 tempest-VolumesSnapshotsTestJSON-707916068-project] Request method failure captured: Jun 22 10:28:51.476509 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: request: GET /compute/v2.1/os-snapshots/e6a4a5ce-7688-4a49-afb5-af5f442cb007 HTTP/1.1 Jun 22 10:28:51.476509 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Accept: application/json Jun 22 10:28:51.476509 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Accept-Encoding: identity Jun 22 10:28:51.476509 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Connection: close Jun 22 10:28:51.476509 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Content-Length: 0 Jun 22 10:28:51.476509 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Content-Type: application/json Jun 22 10:28:51.476509 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Host: 10.222.0.66 Jun 22 10:28:51.476509 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Openstack-System-Scope: None Jun 22 10:28:51.476509 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: User-Agent: python-urllib3/1.26.9 Jun 22 10:28:51.476509 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Auth-Token: gAAAAABisu7akOF2Zv70UYLWF-m0WdL9pXVe5UZZQmMF7tDR39wnZ3R1_6u97ERc8Oql5Q1UUw0xn-NiJd8dqTtC1pCW4WSJX7JuJ7CsQa9jvPMa5GGUsWpUWUOaPMdNytQtScma6H5oNP9sprMTYWifuax7rwgwFq2_qkBOIkIrhCnNcNYr7qE Jun 22 10:28:51.476509 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Domain-Id: None Jun 22 10:28:51.476509 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Domain-Name: None Jun 22 10:28:51.476509 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Identity-Status: Confirmed Jun 22 10:28:51.476509 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Is-Admin-Project: True Jun 22 10:28:51.476509 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Domain-Id: default Jun 22 10:28:51.476509 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Domain-Name: Default Jun 22 10:28:51.476509 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Id: 023252a8411e4e8197bb918a03563c1c Jun 22 10:28:51.476509 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-707916068 Jun 22 10:28:51.476509 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Role: member,reader Jun 22 10:28:51.476509 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Roles: member,reader Jun 22 10:28:51.478563 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_023252a8411e4e8197bb918a03563c1c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/023252a8411e4e8197bb918a03563c1c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/023252a8411e4e8197bb918a03563c1c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/023252a8411e4e8197bb918a03563c1c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}] Jun 22 10:28:51.478563 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant: tempest-VolumesSnapshotsTestJSON-707916068 Jun 22 10:28:51.478563 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant-Id: 023252a8411e4e8197bb918a03563c1c Jun 22 10:28:51.478563 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-707916068 Jun 22 10:28:51.478563 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User: tempest-VolumesSnapshotsTestJSON-707916068-project Jun 22 10:28:51.478563 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Domain-Id: default Jun 22 10:28:51.478563 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Domain-Name: Default Jun 22 10:28:51.478563 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Id: 1c6af0c2291c433aaeac05c7fcb3d002 Jun 22 10:28:51.478563 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Name: tempest-VolumesSnapshotsTestJSON-707916068-project Jun 22 10:28:51.478563 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: method: Jun 22 10:28:51.478563 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: exception: Snapshot e6a4a5ce-7688-4a49-afb5-af5f442cb007 could not be found. Jun 22 10:28:51.478563 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: action_args: {'id': 'e6a4a5ce-7688-4a49-afb5-af5f442cb007'} Jun 22 10:28:51.478563 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:28:51.479410 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:28:51.479410 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 22 10:28:51.479410 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 22 10:28:51.479410 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 22 10:28:51.479410 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 22 10:28:51.479410 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 22 10:28:51.479410 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 22 10:28:51.479410 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 10:28:51.479410 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 10:28:51.479410 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 10:28:51.479410 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 10:28:51.479410 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 10:28:51.479410 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 10:28:51.479410 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 10:28:51.479410 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 10:28:51.479410 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot e6a4a5ce-7688-4a49-afb5-af5f442cb007 could not be found. (HTTP 404) (Request-ID: req-c600deee-bed8-4262-828c-4d475cdb8776) Jun 22 10:28:51.479410 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:28:51.479410 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:28:51.480770 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:28:51.480770 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:28:51.480770 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 22 10:28:51.480770 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 22 10:28:51.480770 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 10:28:51.480770 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 10:28:51.480770 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 22 10:28:51.480770 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 22 10:28:51.480770 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 10:28:51.480770 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 10:28:51.480770 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 22 10:28:51.480770 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 22 10:28:51.480770 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 22 10:28:51.480770 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 22 10:28:51.480770 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 22 10:28:51.480770 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 22 10:28:51.480770 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 10:28:51.480770 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 10:28:51.480770 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 10:28:51.482064 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 10:28:51.482064 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 10:28:51.482064 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 10:28:51.482064 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 10:28:51.482064 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 10:28:51.482064 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot e6a4a5ce-7688-4a49-afb5-af5f442cb007 could not be found. Jun 22 10:28:51.482064 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:28:51.482064 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:28:51.482064 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:28:51.482064 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:28:51.482064 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:28:51.482064 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:28:51.482064 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:28:51.482064 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:28:51.482064 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 10:28:51.482064 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 10:28:51.482064 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:28:51.482064 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:28:51.482064 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 22 10:28:51.482064 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:28:51.483800 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot e6a4a5ce-7688-4a49-afb5-af5f442cb007 could not be found. Jun 22 10:28:51.483800 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:28:51.483800 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:28:51.483800 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:28:51.483800 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:28:51.483800 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:28:51.483800 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:28:51.483800 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:28:51.483800 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:28:51.483800 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot e6a4a5ce-7688-4a49-afb5-af5f442cb007 could not be found. Jun 22 10:28:51.483800 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:28:51.483800 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-c1710923-7226-45e1-b3b0-afd51b3515a1 tempest-VolumesSnapshotsTestJSON-707916068 tempest-VolumesSnapshotsTestJSON-707916068-project] Returning 404 to user: Snapshot e6a4a5ce-7688-4a49-afb5-af5f442cb007 could not be found. {{(pid=117680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:28:51.483800 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-c1710923-7226-45e1-b3b0-afd51b3515a1 tempest-VolumesSnapshotsTestJSON-707916068 tempest-VolumesSnapshotsTestJSON-707916068-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/e6a4a5ce-7688-4a49-afb5-af5f442cb007" status: 404 len: 111 microversion: 2.1 time: 0.077025 Jun 22 10:28:51.483800 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 390/755] 10.222.0.66 () {58 vars in 1250 bytes} [Wed Jun 22 10:28:51 2022] GET /compute/v2.1/os-snapshots/e6a4a5ce-7688-4a49-afb5-af5f442cb007 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 22 10:28:51.494091 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-a7bdef22-a248-4482-9571-9719edf86585 tempest-VolumesSnapshotsTestJSON-707916068 tempest-VolumesSnapshotsTestJSON-707916068-project] Calling method '.version_select at 0x7f60d9700ee0>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:51.509115 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-43ff7a05-93ff-4614-bd49-81a3c91d2ec0 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:51.522666 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-43ff7a05-93ff-4614-bd49-81a3c91d2ec0 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa" status: 200 len: 1362 microversion: 2.1 time: 0.246100 Jun 22 10:28:51.523669 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 366/756] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:51 2022] GET /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa => generated 1362 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:28:51.566866 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-a7bdef22-a248-4482-9571-9719edf86585 tempest-VolumesSnapshotsTestJSON-707916068 tempest-VolumesSnapshotsTestJSON-707916068-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/96c54b16-6841-4e3e-b2e1-e9e13c571058" status: 202 len: 0 microversion: 2.1 time: 0.079561 Jun 22 10:28:51.567628 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 391/757] 10.222.0.66 () {58 vars in 1247 bytes} [Wed Jun 22 10:28:51 2022] DELETE /compute/v2.1/os-volumes/96c54b16-6841-4e3e-b2e1-e9e13c571058 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 22 10:28:51.577512 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-e87cbed1-15ca-4a7d-9b99-a4d876cb5ce1 tempest-VolumesSnapshotsTestJSON-707916068 tempest-VolumesSnapshotsTestJSON-707916068-project] Calling method '.version_select at 0x7f60d9f43040>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:51.636003 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-e87cbed1-15ca-4a7d-9b99-a4d876cb5ce1 tempest-VolumesSnapshotsTestJSON-707916068 tempest-VolumesSnapshotsTestJSON-707916068-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/96c54b16-6841-4e3e-b2e1-e9e13c571058" status: 200 len: 344 microversion: 2.1 time: 0.062653 Jun 22 10:28:51.637043 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 367/758] 10.222.0.66 () {58 vars in 1244 bytes} [Wed Jun 22 10:28:51 2022] GET /compute/v2.1/os-volumes/96c54b16-6841-4e3e-b2e1-e9e13c571058 => generated 344 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:28:52.549256 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-dbae66fc-325e-40fe-8a66-8269618d1464 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:52.550005 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-dbae66fc-325e-40fe-8a66-8269618d1464 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: a1520a14-618c-4e2d-b20d-a08ebd9f6daa] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:52.552281 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:28:52.558562 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-dbae66fc-325e-40fe-8a66-8269618d1464 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:52.559014 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-dbae66fc-325e-40fe-8a66-8269618d1464 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:52.559821 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-dbae66fc-325e-40fe-8a66-8269618d1464 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:52.560293 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-dbae66fc-325e-40fe-8a66-8269618d1464 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:52.654894 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-2bcd7089-6ef4-4629-ac82-3a61de33b8f0 tempest-VolumesSnapshotsTestJSON-707916068 tempest-VolumesSnapshotsTestJSON-707916068-project] Calling method '.version_select at 0x7f60d9f02ca0>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:52.703644 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.wsgi [None req-2bcd7089-6ef4-4629-ac82-3a61de33b8f0 tempest-VolumesSnapshotsTestJSON-707916068 tempest-VolumesSnapshotsTestJSON-707916068-project] HTTP exception thrown: Volume 96c54b16-6841-4e3e-b2e1-e9e13c571058 could not be found. Jun 22 10:28:52.707081 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-2bcd7089-6ef4-4629-ac82-3a61de33b8f0 tempest-VolumesSnapshotsTestJSON-707916068 tempest-VolumesSnapshotsTestJSON-707916068-project] Request method failure captured: Jun 22 10:28:52.707081 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: request: GET /compute/v2.1/os-volumes/96c54b16-6841-4e3e-b2e1-e9e13c571058 HTTP/1.1 Jun 22 10:28:52.707081 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Accept: application/json Jun 22 10:28:52.707081 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Accept-Encoding: identity Jun 22 10:28:52.707081 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Connection: close Jun 22 10:28:52.707081 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Content-Length: 0 Jun 22 10:28:52.707081 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Content-Type: application/json Jun 22 10:28:52.707081 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Host: 10.222.0.66 Jun 22 10:28:52.707081 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Openstack-System-Scope: None Jun 22 10:28:52.707081 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: User-Agent: python-urllib3/1.26.9 Jun 22 10:28:52.707081 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Auth-Token: gAAAAABisu7akOF2Zv70UYLWF-m0WdL9pXVe5UZZQmMF7tDR39wnZ3R1_6u97ERc8Oql5Q1UUw0xn-NiJd8dqTtC1pCW4WSJX7JuJ7CsQa9jvPMa5GGUsWpUWUOaPMdNytQtScma6H5oNP9sprMTYWifuax7rwgwFq2_qkBOIkIrhCnNcNYr7qE Jun 22 10:28:52.707081 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Domain-Id: None Jun 22 10:28:52.707081 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Domain-Name: None Jun 22 10:28:52.707081 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Identity-Status: Confirmed Jun 22 10:28:52.707081 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Is-Admin-Project: True Jun 22 10:28:52.707081 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Domain-Id: default Jun 22 10:28:52.707081 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Domain-Name: Default Jun 22 10:28:52.707081 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Id: 023252a8411e4e8197bb918a03563c1c Jun 22 10:28:52.707081 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-707916068 Jun 22 10:28:52.707081 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Role: member,reader Jun 22 10:28:52.707081 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Roles: member,reader Jun 22 10:28:52.710010 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_023252a8411e4e8197bb918a03563c1c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/023252a8411e4e8197bb918a03563c1c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/023252a8411e4e8197bb918a03563c1c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/023252a8411e4e8197bb918a03563c1c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}] Jun 22 10:28:52.710010 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Tenant: tempest-VolumesSnapshotsTestJSON-707916068 Jun 22 10:28:52.710010 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Tenant-Id: 023252a8411e4e8197bb918a03563c1c Jun 22 10:28:52.710010 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-707916068 Jun 22 10:28:52.710010 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User: tempest-VolumesSnapshotsTestJSON-707916068-project Jun 22 10:28:52.710010 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Domain-Id: default Jun 22 10:28:52.710010 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Domain-Name: Default Jun 22 10:28:52.710010 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Id: 1c6af0c2291c433aaeac05c7fcb3d002 Jun 22 10:28:52.710010 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Name: tempest-VolumesSnapshotsTestJSON-707916068-project Jun 22 10:28:52.710010 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: method: Jun 22 10:28:52.710010 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: exception: Volume 96c54b16-6841-4e3e-b2e1-e9e13c571058 could not be found. Jun 22 10:28:52.710010 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: action_args: {'id': '96c54b16-6841-4e3e-b2e1-e9e13c571058'} Jun 22 10:28:52.710010 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:28:52.711889 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:28:52.711889 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 10:28:52.711889 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 10:28:52.711889 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 10:28:52.711889 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 10:28:52.711889 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 10:28:52.711889 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 10:28:52.711889 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 10:28:52.711889 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 10:28:52.711889 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 10:28:52.711889 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 10:28:52.711889 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 10:28:52.711889 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 10:28:52.711889 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 10:28:52.711889 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 10:28:52.711889 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 96c54b16-6841-4e3e-b2e1-e9e13c571058 could not be found. (HTTP 404) (Request-ID: req-6954fd2c-c807-45b3-a467-bf187ee96487) Jun 22 10:28:52.711889 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:28:52.711889 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:28:52.711889 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:28:52.715015 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:28:52.715015 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 22 10:28:52.715015 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 22 10:28:52.715015 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 10:28:52.715015 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 10:28:52.715015 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 22 10:28:52.715015 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 22 10:28:52.715015 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 10:28:52.715015 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 10:28:52.715015 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 10:28:52.715015 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 10:28:52.715015 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 10:28:52.715015 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 10:28:52.715015 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 10:28:52.715015 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 10:28:52.715015 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 10:28:52.715015 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 10:28:52.715015 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 10:28:52.715015 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 10:28:52.717434 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 10:28:52.717434 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 10:28:52.717434 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 10:28:52.717434 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 10:28:52.717434 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 96c54b16-6841-4e3e-b2e1-e9e13c571058 could not be found. Jun 22 10:28:52.717434 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:28:52.717434 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:28:52.717434 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:28:52.717434 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:28:52.717434 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:28:52.717434 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:28:52.717434 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:28:52.717434 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:28:52.717434 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 10:28:52.717434 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 10:28:52.717434 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:28:52.717434 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:28:52.717434 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 22 10:28:52.717434 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:28:52.720282 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 96c54b16-6841-4e3e-b2e1-e9e13c571058 could not be found. Jun 22 10:28:52.720282 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:28:52.720282 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:28:52.720282 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:28:52.720282 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:28:52.720282 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:28:52.720282 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:28:52.720282 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:28:52.720282 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:28:52.720282 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 96c54b16-6841-4e3e-b2e1-e9e13c571058 could not be found. Jun 22 10:28:52.720282 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:28:52.720282 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-2bcd7089-6ef4-4629-ac82-3a61de33b8f0 tempest-VolumesSnapshotsTestJSON-707916068 tempest-VolumesSnapshotsTestJSON-707916068-project] Returning 404 to user: Volume 96c54b16-6841-4e3e-b2e1-e9e13c571058 could not be found. {{(pid=117679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:28:52.720282 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-2bcd7089-6ef4-4629-ac82-3a61de33b8f0 tempest-VolumesSnapshotsTestJSON-707916068 tempest-VolumesSnapshotsTestJSON-707916068-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/96c54b16-6841-4e3e-b2e1-e9e13c571058" status: 404 len: 109 microversion: 2.1 time: 0.058875 Jun 22 10:28:52.720282 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 368/759] 10.222.0.66 () {58 vars in 1244 bytes} [Wed Jun 22 10:28:52 2022] GET /compute/v2.1/os-volumes/96c54b16-6841-4e3e-b2e1-e9e13c571058 => generated 109 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:28:52.724731 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-5f003d26-b503-4fa9-b181-cc90879256b2 tempest-VolumesSnapshotsTestJSON-707916068 tempest-VolumesSnapshotsTestJSON-707916068-project] Calling method '.version_select at 0x7f60d9f7c8b0>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:52.731726 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-dbae66fc-325e-40fe-8a66-8269618d1464 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:52.741246 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-dbae66fc-325e-40fe-8a66-8269618d1464 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa" status: 200 len: 1362 microversion: 2.1 time: 0.196710 Jun 22 10:28:52.742127 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 392/760] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:52 2022] GET /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa => generated 1362 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:28:52.755295 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.wsgi [None req-5f003d26-b503-4fa9-b181-cc90879256b2 tempest-VolumesSnapshotsTestJSON-707916068 tempest-VolumesSnapshotsTestJSON-707916068-project] HTTP exception thrown: Volume 96c54b16-6841-4e3e-b2e1-e9e13c571058 could not be found. Jun 22 10:28:52.757358 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-5f003d26-b503-4fa9-b181-cc90879256b2 tempest-VolumesSnapshotsTestJSON-707916068 tempest-VolumesSnapshotsTestJSON-707916068-project] Request method failure captured: Jun 22 10:28:52.757358 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: request: DELETE /compute/v2.1/os-volumes/96c54b16-6841-4e3e-b2e1-e9e13c571058 HTTP/1.1 Jun 22 10:28:52.757358 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Accept: application/json Jun 22 10:28:52.757358 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Accept-Encoding: identity Jun 22 10:28:52.757358 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Connection: close Jun 22 10:28:52.757358 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Content-Length: 0 Jun 22 10:28:52.757358 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Content-Type: application/json Jun 22 10:28:52.757358 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Host: 10.222.0.66 Jun 22 10:28:52.757358 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Openstack-System-Scope: None Jun 22 10:28:52.757358 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: User-Agent: python-urllib3/1.26.9 Jun 22 10:28:52.757358 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Auth-Token: gAAAAABisu7akOF2Zv70UYLWF-m0WdL9pXVe5UZZQmMF7tDR39wnZ3R1_6u97ERc8Oql5Q1UUw0xn-NiJd8dqTtC1pCW4WSJX7JuJ7CsQa9jvPMa5GGUsWpUWUOaPMdNytQtScma6H5oNP9sprMTYWifuax7rwgwFq2_qkBOIkIrhCnNcNYr7qE Jun 22 10:28:52.757358 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Domain-Id: None Jun 22 10:28:52.757358 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Domain-Name: None Jun 22 10:28:52.757358 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Identity-Status: Confirmed Jun 22 10:28:52.757358 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Is-Admin-Project: True Jun 22 10:28:52.757358 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Domain-Id: default Jun 22 10:28:52.757358 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Domain-Name: Default Jun 22 10:28:52.757358 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Id: 023252a8411e4e8197bb918a03563c1c Jun 22 10:28:52.757358 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-707916068 Jun 22 10:28:52.757358 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Role: member,reader Jun 22 10:28:52.757358 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Roles: member,reader Jun 22 10:28:52.760478 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_023252a8411e4e8197bb918a03563c1c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/023252a8411e4e8197bb918a03563c1c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/023252a8411e4e8197bb918a03563c1c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/023252a8411e4e8197bb918a03563c1c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}] Jun 22 10:28:52.760478 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Tenant: tempest-VolumesSnapshotsTestJSON-707916068 Jun 22 10:28:52.760478 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Tenant-Id: 023252a8411e4e8197bb918a03563c1c Jun 22 10:28:52.760478 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-707916068 Jun 22 10:28:52.760478 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User: tempest-VolumesSnapshotsTestJSON-707916068-project Jun 22 10:28:52.760478 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Domain-Id: default Jun 22 10:28:52.760478 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Domain-Name: Default Jun 22 10:28:52.760478 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Id: 1c6af0c2291c433aaeac05c7fcb3d002 Jun 22 10:28:52.760478 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Name: tempest-VolumesSnapshotsTestJSON-707916068-project Jun 22 10:28:52.760478 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: method: Jun 22 10:28:52.760478 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: exception: Volume 96c54b16-6841-4e3e-b2e1-e9e13c571058 could not be found. Jun 22 10:28:52.760478 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: action_args: {'id': '96c54b16-6841-4e3e-b2e1-e9e13c571058'} Jun 22 10:28:52.760478 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:28:52.762284 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:28:52.762284 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 10:28:52.762284 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 10:28:52.762284 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 22 10:28:52.762284 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 22 10:28:52.762284 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 22 10:28:52.762284 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 22 10:28:52.762284 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 22 10:28:52.762284 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 22 10:28:52.762284 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 22 10:28:52.762284 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 22 10:28:52.762284 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 10:28:52.762284 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 10:28:52.762284 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 10:28:52.762284 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 10:28:52.762284 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 96c54b16-6841-4e3e-b2e1-e9e13c571058 could not be found. (HTTP 404) (Request-ID: req-856ffb6b-9cb1-4814-845f-078eb710c5e6) Jun 22 10:28:52.762284 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:28:52.762284 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:28:52.762284 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:28:52.765314 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:28:52.765314 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 22 10:28:52.765314 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 22 10:28:52.765314 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 10:28:52.765314 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 10:28:52.765314 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 22 10:28:52.765314 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 22 10:28:52.765314 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 10:28:52.765314 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 10:28:52.765314 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 10:28:52.765314 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 10:28:52.765314 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 22 10:28:52.765314 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 22 10:28:52.765314 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 22 10:28:52.765314 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 22 10:28:52.765314 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 22 10:28:52.765314 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 22 10:28:52.765314 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 22 10:28:52.765314 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 22 10:28:52.767520 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 10:28:52.767520 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 10:28:52.767520 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 10:28:52.767520 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 10:28:52.767520 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 96c54b16-6841-4e3e-b2e1-e9e13c571058 could not be found. Jun 22 10:28:52.767520 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:28:52.767520 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:28:52.767520 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:28:52.767520 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:28:52.767520 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:28:52.767520 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:28:52.767520 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:28:52.767520 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:28:52.767520 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 10:28:52.767520 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 10:28:52.767520 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:28:52.767520 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:28:52.767520 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 22 10:28:52.767520 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:28:52.769693 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 96c54b16-6841-4e3e-b2e1-e9e13c571058 could not be found. Jun 22 10:28:52.769693 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:28:52.769693 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:28:52.769693 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:28:52.769693 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:28:52.769693 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:28:52.769693 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:28:52.769693 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:28:52.769693 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:28:52.769693 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 96c54b16-6841-4e3e-b2e1-e9e13c571058 could not be found. Jun 22 10:28:52.769693 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:28:52.769693 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-5f003d26-b503-4fa9-b181-cc90879256b2 tempest-VolumesSnapshotsTestJSON-707916068 tempest-VolumesSnapshotsTestJSON-707916068-project] Returning 404 to user: Volume 96c54b16-6841-4e3e-b2e1-e9e13c571058 could not be found. {{(pid=117679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:28:52.769693 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-5f003d26-b503-4fa9-b181-cc90879256b2 tempest-VolumesSnapshotsTestJSON-707916068 tempest-VolumesSnapshotsTestJSON-707916068-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/96c54b16-6841-4e3e-b2e1-e9e13c571058" status: 404 len: 109 microversion: 2.1 time: 0.039165 Jun 22 10:28:52.769693 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 369/761] 10.222.0.66 () {58 vars in 1247 bytes} [Wed Jun 22 10:28:52 2022] DELETE /compute/v2.1/os-volumes/96c54b16-6841-4e3e-b2e1-e9e13c571058 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 22 10:28:52.771586 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-209d24e9-b27b-475b-a1e8-0917b2e4858f tempest-VolumesSnapshotsTestJSON-707916068 tempest-VolumesSnapshotsTestJSON-707916068-project] Calling method '.version_select at 0x7f60d97005e0>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:52.807172 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.wsgi [None req-209d24e9-b27b-475b-a1e8-0917b2e4858f tempest-VolumesSnapshotsTestJSON-707916068 tempest-VolumesSnapshotsTestJSON-707916068-project] HTTP exception thrown: Volume 96c54b16-6841-4e3e-b2e1-e9e13c571058 could not be found. Jun 22 10:28:52.809401 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-209d24e9-b27b-475b-a1e8-0917b2e4858f tempest-VolumesSnapshotsTestJSON-707916068 tempest-VolumesSnapshotsTestJSON-707916068-project] Request method failure captured: Jun 22 10:28:52.809401 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: request: GET /compute/v2.1/os-volumes/96c54b16-6841-4e3e-b2e1-e9e13c571058 HTTP/1.1 Jun 22 10:28:52.809401 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Accept: application/json Jun 22 10:28:52.809401 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Accept-Encoding: identity Jun 22 10:28:52.809401 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Connection: close Jun 22 10:28:52.809401 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Content-Length: 0 Jun 22 10:28:52.809401 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Content-Type: application/json Jun 22 10:28:52.809401 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Host: 10.222.0.66 Jun 22 10:28:52.809401 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Openstack-System-Scope: None Jun 22 10:28:52.809401 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: User-Agent: python-urllib3/1.26.9 Jun 22 10:28:52.809401 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Auth-Token: gAAAAABisu7akOF2Zv70UYLWF-m0WdL9pXVe5UZZQmMF7tDR39wnZ3R1_6u97ERc8Oql5Q1UUw0xn-NiJd8dqTtC1pCW4WSJX7JuJ7CsQa9jvPMa5GGUsWpUWUOaPMdNytQtScma6H5oNP9sprMTYWifuax7rwgwFq2_qkBOIkIrhCnNcNYr7qE Jun 22 10:28:52.809401 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Domain-Id: None Jun 22 10:28:52.809401 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Domain-Name: None Jun 22 10:28:52.809401 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Identity-Status: Confirmed Jun 22 10:28:52.809401 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Is-Admin-Project: True Jun 22 10:28:52.809401 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Domain-Id: default Jun 22 10:28:52.809401 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Domain-Name: Default Jun 22 10:28:52.809401 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Id: 023252a8411e4e8197bb918a03563c1c Jun 22 10:28:52.809401 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-707916068 Jun 22 10:28:52.809401 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Role: member,reader Jun 22 10:28:52.809401 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Roles: member,reader Jun 22 10:28:52.811880 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_023252a8411e4e8197bb918a03563c1c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/023252a8411e4e8197bb918a03563c1c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/023252a8411e4e8197bb918a03563c1c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/023252a8411e4e8197bb918a03563c1c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}] Jun 22 10:28:52.811880 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant: tempest-VolumesSnapshotsTestJSON-707916068 Jun 22 10:28:52.811880 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant-Id: 023252a8411e4e8197bb918a03563c1c Jun 22 10:28:52.811880 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-707916068 Jun 22 10:28:52.811880 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User: tempest-VolumesSnapshotsTestJSON-707916068-project Jun 22 10:28:52.811880 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Domain-Id: default Jun 22 10:28:52.811880 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Domain-Name: Default Jun 22 10:28:52.811880 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Id: 1c6af0c2291c433aaeac05c7fcb3d002 Jun 22 10:28:52.811880 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Name: tempest-VolumesSnapshotsTestJSON-707916068-project Jun 22 10:28:52.811880 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: method: Jun 22 10:28:52.811880 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: exception: Volume 96c54b16-6841-4e3e-b2e1-e9e13c571058 could not be found. Jun 22 10:28:52.811880 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: action_args: {'id': '96c54b16-6841-4e3e-b2e1-e9e13c571058'} Jun 22 10:28:52.811880 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:28:52.813065 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:28:52.813065 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 10:28:52.813065 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 10:28:52.813065 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 10:28:52.813065 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 10:28:52.813065 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 10:28:52.813065 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 10:28:52.813065 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 10:28:52.813065 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 10:28:52.813065 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 10:28:52.813065 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 10:28:52.813065 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 10:28:52.813065 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 10:28:52.813065 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 10:28:52.813065 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 10:28:52.813065 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 96c54b16-6841-4e3e-b2e1-e9e13c571058 could not be found. (HTTP 404) (Request-ID: req-a59543a6-8728-4382-ad9d-6caa1717c58a) Jun 22 10:28:52.813065 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:28:52.813065 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:28:52.813065 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:28:52.814167 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:28:52.814167 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 22 10:28:52.814167 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 22 10:28:52.814167 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 22 10:28:52.814167 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 22 10:28:52.814167 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 22 10:28:52.814167 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 22 10:28:52.814167 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 22 10:28:52.814167 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 22 10:28:52.814167 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 22 10:28:52.814167 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 22 10:28:52.814167 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 22 10:28:52.814167 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 22 10:28:52.814167 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 22 10:28:52.814167 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 22 10:28:52.814167 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 22 10:28:52.814167 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 22 10:28:52.814167 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 22 10:28:52.814167 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 22 10:28:52.815371 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 22 10:28:52.815371 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 22 10:28:52.815371 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 22 10:28:52.815371 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 22 10:28:52.815371 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 96c54b16-6841-4e3e-b2e1-e9e13c571058 could not be found. Jun 22 10:28:52.815371 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:28:52.815371 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:28:52.815371 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:28:52.815371 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:28:52.815371 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:28:52.815371 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:28:52.815371 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:28:52.815371 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:28:52.815371 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 22 10:28:52.815371 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 22 10:28:52.815371 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:28:52.815371 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:28:52.815371 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 22 10:28:52.815371 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:28:52.816540 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 96c54b16-6841-4e3e-b2e1-e9e13c571058 could not be found. Jun 22 10:28:52.816540 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:28:52.816540 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:28:52.816540 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:28:52.816540 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:28:52.816540 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:28:52.816540 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:28:52.816540 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:28:52.816540 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:28:52.816540 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 96c54b16-6841-4e3e-b2e1-e9e13c571058 could not be found. Jun 22 10:28:52.816540 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:28:52.816540 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-209d24e9-b27b-475b-a1e8-0917b2e4858f tempest-VolumesSnapshotsTestJSON-707916068 tempest-VolumesSnapshotsTestJSON-707916068-project] Returning 404 to user: Volume 96c54b16-6841-4e3e-b2e1-e9e13c571058 could not be found. {{(pid=117680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:28:52.816540 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-209d24e9-b27b-475b-a1e8-0917b2e4858f tempest-VolumesSnapshotsTestJSON-707916068 tempest-VolumesSnapshotsTestJSON-707916068-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/96c54b16-6841-4e3e-b2e1-e9e13c571058" status: 404 len: 109 microversion: 2.1 time: 0.046057 Jun 22 10:28:52.816540 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 393/762] 10.222.0.66 () {58 vars in 1244 bytes} [Wed Jun 22 10:28:52 2022] GET /compute/v2.1/os-volumes/96c54b16-6841-4e3e-b2e1-e9e13c571058 => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 22 10:28:53.771076 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-371f005f-f980-491e-b48b-8509968c1ed5 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:53.772142 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-371f005f-f980-491e-b48b-8509968c1ed5 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: a1520a14-618c-4e2d-b20d-a08ebd9f6daa] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:53.786692 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-371f005f-f980-491e-b48b-8509968c1ed5 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:53.787494 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-371f005f-f980-491e-b48b-8509968c1ed5 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:53.788867 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-371f005f-f980-491e-b48b-8509968c1ed5 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:53.789635 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-371f005f-f980-491e-b48b-8509968c1ed5 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:53.982034 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-371f005f-f980-491e-b48b-8509968c1ed5 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:53.990979 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-371f005f-f980-491e-b48b-8509968c1ed5 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa" status: 200 len: 1362 microversion: 2.1 time: 0.227253 Jun 22 10:28:53.991340 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 370/763] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:53 2022] GET /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa => generated 1362 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:28:55.005436 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell0:SELECT=2 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:28:55.006786 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell0:SELECT=10 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:28:55.011209 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-7184e9b4-1ef9-4361-aadb-15771cf5a6f5 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:55.011832 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-7184e9b4-1ef9-4361-aadb-15771cf5a6f5 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: a1520a14-618c-4e2d-b20d-a08ebd9f6daa] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:55.021356 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7184e9b4-1ef9-4361-aadb-15771cf5a6f5 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:55.021356 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7184e9b4-1ef9-4361-aadb-15771cf5a6f5 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:55.021712 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7184e9b4-1ef9-4361-aadb-15771cf5a6f5 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:55.021832 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7184e9b4-1ef9-4361-aadb-15771cf5a6f5 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:55.203702 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-7184e9b4-1ef9-4361-aadb-15771cf5a6f5 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:55.213048 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-7184e9b4-1ef9-4361-aadb-15771cf5a6f5 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa" status: 200 len: 1362 microversion: 2.1 time: 0.208698 Jun 22 10:28:55.214374 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 394/764] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:55 2022] GET /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa => generated 1362 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:28:56.238107 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-bc42dd89-e6d3-4297-8835-90cd001cdb42 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:56.238838 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-bc42dd89-e6d3-4297-8835-90cd001cdb42 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: a1520a14-618c-4e2d-b20d-a08ebd9f6daa] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:56.240836 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_cell0:SELECT=2 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:28:56.247962 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-bc42dd89-e6d3-4297-8835-90cd001cdb42 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:56.248489 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-bc42dd89-e6d3-4297-8835-90cd001cdb42 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:56.249356 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-bc42dd89-e6d3-4297-8835-90cd001cdb42 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:56.249843 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-bc42dd89-e6d3-4297-8835-90cd001cdb42 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:56.396103 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-bc42dd89-e6d3-4297-8835-90cd001cdb42 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:56.406097 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-bc42dd89-e6d3-4297-8835-90cd001cdb42 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa" status: 200 len: 1362 microversion: 2.1 time: 0.172160 Jun 22 10:28:56.406810 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 371/765] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:56 2022] GET /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:28:57.424986 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-80956fc4-9890-4143-81ac-70e7a1693e02 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:57.426101 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-80956fc4-9890-4143-81ac-70e7a1693e02 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: a1520a14-618c-4e2d-b20d-a08ebd9f6daa] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:57.434491 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-80956fc4-9890-4143-81ac-70e7a1693e02 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:57.435096 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-80956fc4-9890-4143-81ac-70e7a1693e02 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:57.435964 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-80956fc4-9890-4143-81ac-70e7a1693e02 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:57.436536 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-80956fc4-9890-4143-81ac-70e7a1693e02 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:57.597980 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-80956fc4-9890-4143-81ac-70e7a1693e02 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:57.606593 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-80956fc4-9890-4143-81ac-70e7a1693e02 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa" status: 200 len: 1362 microversion: 2.1 time: 0.185710 Jun 22 10:28:57.607200 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 395/766] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:57 2022] GET /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa => generated 1362 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:28:57.986432 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-e95b928e-7d31-4cd7-b16e-eea706e3ae9e req-41258013-0cce-4556-957a-e58231859b84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1520a14-618c-4e2d-b20d-a08ebd9f6daa", "name": "network-vif-plugged", "status": "completed", "tag": "f2855566-99ba-4484-9767-575224b0c7dc"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:28:57.999567 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-e95b928e-7d31-4cd7-b16e-eea706e3ae9e req-41258013-0cce-4556-957a-e58231859b84 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:58.000281 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-e95b928e-7d31-4cd7-b16e-eea706e3ae9e req-41258013-0cce-4556-957a-e58231859b84 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:58.015137 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-e95b928e-7d31-4cd7-b16e-eea706e3ae9e req-41258013-0cce-4556-957a-e58231859b84 service nova] Creating event network-vif-plugged:f2855566-99ba-4484-9767-575224b0c7dc for instance a1520a14-618c-4e2d-b20d-a08ebd9f6daa on hv-cinder-84713 Jun 22 10:28:58.021453 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-e95b928e-7d31-4cd7-b16e-eea706e3ae9e req-41258013-0cce-4556-957a-e58231859b84 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039350 Jun 22 10:28:58.022311 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 372/767] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:28:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:28:58.626865 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-6e969bac-0b36-4333-89b3-5697277b7e78 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:58.627888 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-6e969bac-0b36-4333-89b3-5697277b7e78 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: a1520a14-618c-4e2d-b20d-a08ebd9f6daa] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:58.635763 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6e969bac-0b36-4333-89b3-5697277b7e78 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:58.636217 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6e969bac-0b36-4333-89b3-5697277b7e78 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:58.637121 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6e969bac-0b36-4333-89b3-5697277b7e78 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:58.637584 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6e969bac-0b36-4333-89b3-5697277b7e78 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:58.791021 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-6e969bac-0b36-4333-89b3-5697277b7e78 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:58.799382 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-6e969bac-0b36-4333-89b3-5697277b7e78 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa" status: 200 len: 1362 microversion: 2.1 time: 0.178680 Jun 22 10:28:58.799993 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 396/768] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:58 2022] GET /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:28:59.818414 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-8c40583d-1d3d-4447-81ba-2d2676ea33e7 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:28:59.819116 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-8c40583d-1d3d-4447-81ba-2d2676ea33e7 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: a1520a14-618c-4e2d-b20d-a08ebd9f6daa] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:28:59.826220 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8c40583d-1d3d-4447-81ba-2d2676ea33e7 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:59.826702 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8c40583d-1d3d-4447-81ba-2d2676ea33e7 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:59.827489 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8c40583d-1d3d-4447-81ba-2d2676ea33e7 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:28:59.827922 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8c40583d-1d3d-4447-81ba-2d2676ea33e7 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:28:59.976427 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-8c40583d-1d3d-4447-81ba-2d2676ea33e7 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:28:59.985633 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-8c40583d-1d3d-4447-81ba-2d2676ea33e7 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa" status: 200 len: 1362 microversion: 2.1 time: 0.172051 Jun 22 10:28:59.986229 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 373/769] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:28:59 2022] GET /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:29:01.006466 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-fd180d63-5e67-4c54-904a-100fa0f2e637 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:29:01.007389 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-fd180d63-5e67-4c54-904a-100fa0f2e637 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: a1520a14-618c-4e2d-b20d-a08ebd9f6daa] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:29:01.015061 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fd180d63-5e67-4c54-904a-100fa0f2e637 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:29:01.015502 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fd180d63-5e67-4c54-904a-100fa0f2e637 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:29:01.016308 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fd180d63-5e67-4c54-904a-100fa0f2e637 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:29:01.016772 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fd180d63-5e67-4c54-904a-100fa0f2e637 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:29:01.199370 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-fd180d63-5e67-4c54-904a-100fa0f2e637 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:29:01.207924 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-fd180d63-5e67-4c54-904a-100fa0f2e637 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa" status: 200 len: 1362 microversion: 2.1 time: 0.207433 Jun 22 10:29:01.208559 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 397/770] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:29:00 2022] GET /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa => generated 1362 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:29:02.234240 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-8669c119-5a76-4a07-9ccd-0a6297f5d706 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:29:02.236049 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-8669c119-5a76-4a07-9ccd-0a6297f5d706 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: a1520a14-618c-4e2d-b20d-a08ebd9f6daa] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:29:02.244122 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8669c119-5a76-4a07-9ccd-0a6297f5d706 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:29:02.244710 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8669c119-5a76-4a07-9ccd-0a6297f5d706 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:29:02.245701 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8669c119-5a76-4a07-9ccd-0a6297f5d706 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:29:02.246305 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8669c119-5a76-4a07-9ccd-0a6297f5d706 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:29:02.405572 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-8669c119-5a76-4a07-9ccd-0a6297f5d706 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:29:02.414609 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-8669c119-5a76-4a07-9ccd-0a6297f5d706 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa" status: 200 len: 1362 microversion: 2.1 time: 0.184675 Jun 22 10:29:02.415333 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 374/771] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:29:02 2022] GET /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa => generated 1362 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:29:03.432879 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-8cd012b7-4791-47eb-99fa-5ab523630d3e tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:29:03.433565 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-8cd012b7-4791-47eb-99fa-5ab523630d3e tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: a1520a14-618c-4e2d-b20d-a08ebd9f6daa] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:29:03.440836 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8cd012b7-4791-47eb-99fa-5ab523630d3e tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:29:03.441320 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8cd012b7-4791-47eb-99fa-5ab523630d3e tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:29:03.442125 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8cd012b7-4791-47eb-99fa-5ab523630d3e tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:29:03.442597 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8cd012b7-4791-47eb-99fa-5ab523630d3e tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:29:03.600737 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-8cd012b7-4791-47eb-99fa-5ab523630d3e tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:29:03.610360 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-8cd012b7-4791-47eb-99fa-5ab523630d3e tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa" status: 200 len: 1362 microversion: 2.1 time: 0.181511 Jun 22 10:29:03.611071 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 398/772] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:29:03 2022] GET /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:29:04.631892 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-c3bc5ee8-fe02-4a7b-83d0-c99f202bf340 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:29:04.632993 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-c3bc5ee8-fe02-4a7b-83d0-c99f202bf340 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: a1520a14-618c-4e2d-b20d-a08ebd9f6daa] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:29:04.636723 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:29:04.645088 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c3bc5ee8-fe02-4a7b-83d0-c99f202bf340 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:29:04.646232 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c3bc5ee8-fe02-4a7b-83d0-c99f202bf340 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:29:04.648215 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c3bc5ee8-fe02-4a7b-83d0-c99f202bf340 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:29:04.649858 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c3bc5ee8-fe02-4a7b-83d0-c99f202bf340 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:29:04.813380 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-c3bc5ee8-fe02-4a7b-83d0-c99f202bf340 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:29:04.827354 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-c3bc5ee8-fe02-4a7b-83d0-c99f202bf340 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa" status: 200 len: 1547 microversion: 2.1 time: 0.200217 Jun 22 10:29:04.828155 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 375/773] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:29:04 2022] GET /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa => generated 1547 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:29:04.846057 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-50e28daa-d4fa-45c2-a7d3-cab2cfc6f56b tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:29:04.846740 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-50e28daa-d4fa-45c2-a7d3-cab2cfc6f56b tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: a1520a14-618c-4e2d-b20d-a08ebd9f6daa] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:29:04.855264 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-50e28daa-d4fa-45c2-a7d3-cab2cfc6f56b tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:29:04.855878 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-50e28daa-d4fa-45c2-a7d3-cab2cfc6f56b tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:29:04.856871 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-50e28daa-d4fa-45c2-a7d3-cab2cfc6f56b tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:29:04.857381 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-50e28daa-d4fa-45c2-a7d3-cab2cfc6f56b tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:29:04.949377 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-50e28daa-d4fa-45c2-a7d3-cab2cfc6f56b tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.107462 Jun 22 10:29:04.950420 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 399/774] 10.222.0.66 () {58 vars in 1274 bytes} [Wed Jun 22 10:29:04 2022] GET /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa/os-interface => generated 284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:29:06.454296 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-7ba4cb60-18c4-4b2d-8157-2c7e8890f893 req-3540de38-a1ab-4670-9ad4-0695010a45f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1520a14-618c-4e2d-b20d-a08ebd9f6daa", "tag": "f2855566-99ba-4484-9767-575224b0c7dc"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:29:06.467329 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-7ba4cb60-18c4-4b2d-8157-2c7e8890f893 req-3540de38-a1ab-4670-9ad4-0695010a45f3 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:29:06.468450 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-7ba4cb60-18c4-4b2d-8157-2c7e8890f893 req-3540de38-a1ab-4670-9ad4-0695010a45f3 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:29:06.484750 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-7ba4cb60-18c4-4b2d-8157-2c7e8890f893 req-3540de38-a1ab-4670-9ad4-0695010a45f3 service nova] Creating event network-changed:f2855566-99ba-4484-9767-575224b0c7dc for instance a1520a14-618c-4e2d-b20d-a08ebd9f6daa on hv-cinder-84713 Jun 22 10:29:06.490865 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-7ba4cb60-18c4-4b2d-8157-2c7e8890f893 req-3540de38-a1ab-4670-9ad4-0695010a45f3 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040747 Jun 22 10:29:06.491425 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 376/775] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:29:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:30:08.395684 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_api:SELECT=13 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:08.396670 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:SELECT=53 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:08.402163 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-9aedee7d-a67c-4875-9385-44adacbc2fe6 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:08.403065 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-9aedee7d-a67c-4875-9385-44adacbc2fe6 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:08.411039 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9aedee7d-a67c-4875-9385-44adacbc2fe6 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:08.411494 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9aedee7d-a67c-4875-9385-44adacbc2fe6 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:08.412291 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9aedee7d-a67c-4875-9385-44adacbc2fe6 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:08.412767 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9aedee7d-a67c-4875-9385-44adacbc2fe6 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:08.443463 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-9aedee7d-a67c-4875-9385-44adacbc2fe6 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0/ips" status: 200 len: 151 microversion: 2.20 time: 0.049844 Jun 22 10:30:08.444516 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 400/776] 10.222.0.66 () {60 vars in 1288 bytes} [Wed Jun 22 10:30:08 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0/ips => generated 151 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 22 10:30:09.168826 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_api:SELECT=3 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:09.169747 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_cell1:SELECT=36 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:09.174829 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-e97c8d77-ddf5-401d-ba43-d1cac18e7c3b tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:09.175449 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-e97c8d77-ddf5-401d-ba43-d1cac18e7c3b tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: d02a6b26-3c65-44a5-8c06-88f9e38f30c7] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:09.183196 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e97c8d77-ddf5-401d-ba43-d1cac18e7c3b tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:09.183624 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e97c8d77-ddf5-401d-ba43-d1cac18e7c3b tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:09.184421 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e97c8d77-ddf5-401d-ba43-d1cac18e7c3b tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:09.184862 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e97c8d77-ddf5-401d-ba43-d1cac18e7c3b tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:09.212306 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-e97c8d77-ddf5-401d-ba43-d1cac18e7c3b tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/d02a6b26-3c65-44a5-8c06-88f9e38f30c7/ips" status: 200 len: 151 microversion: 2.1 time: 0.045968 Jun 22 10:30:09.212896 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 377/777] 10.222.0.66 () {58 vars in 1247 bytes} [Wed Jun 22 10:30:09 2022] GET /compute/v2.1/servers/d02a6b26-3c65-44a5-8c06-88f9e38f30c7/ips => generated 151 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:30:14.685568 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-a4c53a2c-c8a1-4444-9272-0f00a8dcb6d5 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:30:14.686487 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-a4c53a2c-c8a1-4444-9272-0f00a8dcb6d5 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:14.693540 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a4c53a2c-c8a1-4444-9272-0f00a8dcb6d5 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:14.694017 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a4c53a2c-c8a1-4444-9272-0f00a8dcb6d5 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:14.694826 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a4c53a2c-c8a1-4444-9272-0f00a8dcb6d5 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:14.695265 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a4c53a2c-c8a1-4444-9272-0f00a8dcb6d5 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:14.721031 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.objects.instance [None req-a4c53a2c-c8a1-4444-9272-0f00a8dcb6d5 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lazy-loading 'flavor' on Instance uuid d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 {{(pid=117680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:30:14.881414 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-906b2cd9-459f-486b-b476-315a2cb60079 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8c2af206-2191-4b9f-84e2-82f03b685e2d"}} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:30:14.882487 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-906b2cd9-459f-486b-b476-315a2cb60079 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: d02a6b26-3c65-44a5-8c06-88f9e38f30c7] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:14.889597 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-906b2cd9-459f-486b-b476-315a2cb60079 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:14.890040 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-906b2cd9-459f-486b-b476-315a2cb60079 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:14.890864 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-906b2cd9-459f-486b-b476-315a2cb60079 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:14.891298 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-906b2cd9-459f-486b-b476-315a2cb60079 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:15.125599 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-a4c53a2c-c8a1-4444-9272-0f00a8dcb6d5 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "POST /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0/action" status: 202 len: 0 microversion: 2.20 time: 0.443397 Jun 22 10:30:15.126787 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 401/778] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Jun 22 10:30:14 2022] POST /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0/action => generated 0 bytes in 446 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 22 10:30:15.136809 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-5beb0a57-3ea4-402e-9ba1-a867be0e07b5 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:15.137474 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-5beb0a57-3ea4-402e-9ba1-a867be0e07b5 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:15.144726 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5beb0a57-3ea4-402e-9ba1-a867be0e07b5 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:15.145170 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5beb0a57-3ea4-402e-9ba1-a867be0e07b5 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:15.145955 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5beb0a57-3ea4-402e-9ba1-a867be0e07b5 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:15.146724 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5beb0a57-3ea4-402e-9ba1-a867be0e07b5 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:15.220868 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-906b2cd9-459f-486b-b476-315a2cb60079 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "POST /compute/v2.1/servers/d02a6b26-3c65-44a5-8c06-88f9e38f30c7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.342707 Jun 22 10:30:15.221968 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 378/779] 10.222.0.66 () {60 vars in 1322 bytes} [Wed Jun 22 10:30:14 2022] POST /compute/v2.1/servers/d02a6b26-3c65-44a5-8c06-88f9e38f30c7/os-volume_attachments => generated 194 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:30:15.324971 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-5beb0a57-3ea4-402e-9ba1-a867be0e07b5 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:15.333864 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-5beb0a57-3ea4-402e-9ba1-a867be0e07b5 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:15.335512 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-5beb0a57-3ea4-402e-9ba1-a867be0e07b5 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:15.336760 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-5beb0a57-3ea4-402e-9ba1-a867be0e07b5 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1723 microversion: 2.20 time: 0.204607 Jun 22 10:30:15.337320 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 402/780] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:30:15 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1723 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:30:16.368186 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-c778da1e-b977-464f-a2e9-1a1257f2020e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:16.368897 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-c778da1e-b977-464f-a2e9-1a1257f2020e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:16.376542 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c778da1e-b977-464f-a2e9-1a1257f2020e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:16.376992 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c778da1e-b977-464f-a2e9-1a1257f2020e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:16.377789 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c778da1e-b977-464f-a2e9-1a1257f2020e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:16.378231 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c778da1e-b977-464f-a2e9-1a1257f2020e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:16.529340 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-c778da1e-b977-464f-a2e9-1a1257f2020e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:16.538601 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-c778da1e-b977-464f-a2e9-1a1257f2020e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:16.540252 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-c778da1e-b977-464f-a2e9-1a1257f2020e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:16.541752 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-c778da1e-b977-464f-a2e9-1a1257f2020e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1723 microversion: 2.20 time: 0.179535 Jun 22 10:30:16.542487 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 379/781] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:30:16 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:30:17.570365 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-58236e9b-b91b-4f2f-8580-cca7be165ced tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:17.571377 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-58236e9b-b91b-4f2f-8580-cca7be165ced tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:17.578404 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-58236e9b-b91b-4f2f-8580-cca7be165ced tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:17.579108 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-58236e9b-b91b-4f2f-8580-cca7be165ced tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:17.580075 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-58236e9b-b91b-4f2f-8580-cca7be165ced tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:17.580719 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-58236e9b-b91b-4f2f-8580-cca7be165ced tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:17.745760 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-58236e9b-b91b-4f2f-8580-cca7be165ced tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:17.754523 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-58236e9b-b91b-4f2f-8580-cca7be165ced tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:17.756051 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-58236e9b-b91b-4f2f-8580-cca7be165ced tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:17.757251 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-58236e9b-b91b-4f2f-8580-cca7be165ced tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1723 microversion: 2.20 time: 0.191626 Jun 22 10:30:17.757812 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 403/782] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:30:17 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1723 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:30:18.779496 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-5b10412f-6e6d-4d26-9077-429ff46c8a4b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:18.780232 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-5b10412f-6e6d-4d26-9077-429ff46c8a4b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:18.787815 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5b10412f-6e6d-4d26-9077-429ff46c8a4b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:18.788298 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5b10412f-6e6d-4d26-9077-429ff46c8a4b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:18.789041 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5b10412f-6e6d-4d26-9077-429ff46c8a4b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:18.789467 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5b10412f-6e6d-4d26-9077-429ff46c8a4b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:18.941674 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-5b10412f-6e6d-4d26-9077-429ff46c8a4b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:18.951008 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-5b10412f-6e6d-4d26-9077-429ff46c8a4b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:18.952608 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-5b10412f-6e6d-4d26-9077-429ff46c8a4b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:18.953830 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-5b10412f-6e6d-4d26-9077-429ff46c8a4b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1723 microversion: 2.20 time: 0.180813 Jun 22 10:30:18.954436 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 380/783] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:30:18 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:30:19.972983 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-1c2de14f-dbf2-40ef-a630-adb1984d458e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:19.973776 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-1c2de14f-dbf2-40ef-a630-adb1984d458e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:19.981715 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1c2de14f-dbf2-40ef-a630-adb1984d458e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:19.982168 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1c2de14f-dbf2-40ef-a630-adb1984d458e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:19.983071 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1c2de14f-dbf2-40ef-a630-adb1984d458e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:19.983509 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1c2de14f-dbf2-40ef-a630-adb1984d458e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:20.180923 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-1c2de14f-dbf2-40ef-a630-adb1984d458e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:20.189731 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-1c2de14f-dbf2-40ef-a630-adb1984d458e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:20.191363 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-1c2de14f-dbf2-40ef-a630-adb1984d458e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:20.192612 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-1c2de14f-dbf2-40ef-a630-adb1984d458e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1723 microversion: 2.20 time: 0.223989 Jun 22 10:30:20.193186 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 404/784] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:30:19 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:30:21.158986 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-a4add7cc-8750-4a7e-8114-573e3adf1b1c tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-34178329", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-666635953", "security_groups": [{"name": "tempest-secgroup-smoke-1054534713"}], "block_device_mapping_v2": [{"uuid": "cdd071ad-9a49-42e8-85c1-da6c4571ad3f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b0565ff5-0ad4-4a38-9f47-51304a15abc7"}]}} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:30:21.216854 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-3a8ede43-f389-4264-9dfc-94c3c87b5623 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:21.218364 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-3a8ede43-f389-4264-9dfc-94c3c87b5623 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:21.230719 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3a8ede43-f389-4264-9dfc-94c3c87b5623 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:21.231565 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3a8ede43-f389-4264-9dfc-94c3c87b5623 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:21.232419 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3a8ede43-f389-4264-9dfc-94c3c87b5623 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:21.233297 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3a8ede43-f389-4264-9dfc-94c3c87b5623 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:21.422338 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.network.neutron [None req-a4add7cc-8750-4a7e-8114-573e3adf1b1c tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] validate_networks() for [('b0565ff5-0ad4-4a38-9f47-51304a15abc7', None, None, None, None, None)] {{(pid=117679) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 10:30:21.554118 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-3a8ede43-f389-4264-9dfc-94c3c87b5623 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:21.563881 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-3a8ede43-f389-4264-9dfc-94c3c87b5623 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:21.565665 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-3a8ede43-f389-4264-9dfc-94c3c87b5623 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:21.567102 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-3a8ede43-f389-4264-9dfc-94c3c87b5623 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1723 microversion: 2.20 time: 0.358438 Jun 22 10:30:21.578442 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 405/785] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:30:21 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1723 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:30:21.907871 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-a4add7cc-8750-4a7e-8114-573e3adf1b1c tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Flavor limits 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 10:30:21.908568 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-a4add7cc-8750-4a7e-8114-573e3adf1b1c tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Image limits 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 10:30:21.909411 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-a4add7cc-8750-4a7e-8114-573e3adf1b1c tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Flavor pref 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 10:30:21.910127 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-a4add7cc-8750-4a7e-8114-573e3adf1b1c tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Image pref 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 10:30:21.910915 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-a4add7cc-8750-4a7e-8114-573e3adf1b1c tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 10:30:21.924034 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a4add7cc-8750-4a7e-8114-573e3adf1b1c tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:21.925175 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a4add7cc-8750-4a7e-8114-573e3adf1b1c tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:21.925749 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a4add7cc-8750-4a7e-8114-573e3adf1b1c tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:21.926255 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a4add7cc-8750-4a7e-8114-573e3adf1b1c tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:21.952871 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.quota [None req-a4add7cc-8750-4a7e-8114-573e3adf1b1c tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Getting quotas for project a4a87feacfb84d6c9f7ea48f230753b7. Resources: {'instances', 'cores', 'ram'} {{(pid=117679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:30:21.959366 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.quota [None req-a4add7cc-8750-4a7e-8114-573e3adf1b1c tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Getting quotas for user a394fc62e6a64a85b855bf2eb56b4b71 and project a4a87feacfb84d6c9f7ea48f230753b7. Resources: {'instances', 'cores', 'ram'} {{(pid=117679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:30:22.063955 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-a4add7cc-8750-4a7e-8114-573e3adf1b1c tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Going to run 1 instances... {{(pid=117679) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 10:30:22.066879 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-a4add7cc-8750-4a7e-8114-573e3adf1b1c tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 10d8ca63-dde5-47f0-a3d5-e0b2473d11ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cdd071ad-9a49-42e8-85c1-da6c4571ad3f',volume_size=None,volume_type=None)] {{(pid=117679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 10:30:22.263734 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-a4add7cc-8750-4a7e-8114-573e3adf1b1c tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.113599 Jun 22 10:30:22.270165 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 381/786] 10.222.0.66 () {60 vars in 1146 bytes} [Wed Jun 22 10:30:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 1121 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 10:30:22.279843 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-543b11c5-244a-48d4-ab6b-ac72d828e73c tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:22.280821 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-543b11c5-244a-48d4-ab6b-ac72d828e73c tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 10d8ca63-dde5-47f0-a3d5-e0b2473d11ab] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:22.380613 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-543b11c5-244a-48d4-ab6b-ac72d828e73c tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a394fc62e6a64a85b855bf2eb56b4b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a87feacfb84d6c9f7ea48f230753b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:22.389199 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-543b11c5-244a-48d4-ab6b-ac72d828e73c tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "GET /compute/v2.1/servers/10d8ca63-dde5-47f0-a3d5-e0b2473d11ab" status: 200 len: 1092 microversion: 2.1 time: 0.117632 Jun 22 10:30:22.390003 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 406/787] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:30:22 2022] GET /compute/v2.1/servers/10d8ca63-dde5-47f0-a3d5-e0b2473d11ab => generated 1092 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:30:22.587045 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-12dc4c2b-a0fa-4d5f-bdaa-54cfd27095b4 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:22.587943 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-12dc4c2b-a0fa-4d5f-bdaa-54cfd27095b4 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:22.595026 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-12dc4c2b-a0fa-4d5f-bdaa-54cfd27095b4 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:22.595484 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-12dc4c2b-a0fa-4d5f-bdaa-54cfd27095b4 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:22.596274 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-12dc4c2b-a0fa-4d5f-bdaa-54cfd27095b4 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:22.596710 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-12dc4c2b-a0fa-4d5f-bdaa-54cfd27095b4 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:22.808355 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-12dc4c2b-a0fa-4d5f-bdaa-54cfd27095b4 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:22.817678 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-12dc4c2b-a0fa-4d5f-bdaa-54cfd27095b4 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:22.819217 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-12dc4c2b-a0fa-4d5f-bdaa-54cfd27095b4 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:22.820633 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-12dc4c2b-a0fa-4d5f-bdaa-54cfd27095b4 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1723 microversion: 2.20 time: 0.238345 Jun 22 10:30:22.821231 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 382/788] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:30:22 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1723 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:30:23.411075 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-cb81be9b-2fcb-4c75-9c5b-30111ab061e3 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:23.412236 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-cb81be9b-2fcb-4c75-9c5b-30111ab061e3 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 10d8ca63-dde5-47f0-a3d5-e0b2473d11ab] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:23.505626 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-cb81be9b-2fcb-4c75-9c5b-30111ab061e3 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a394fc62e6a64a85b855bf2eb56b4b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a87feacfb84d6c9f7ea48f230753b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:23.516352 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-cb81be9b-2fcb-4c75-9c5b-30111ab061e3 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "GET /compute/v2.1/servers/10d8ca63-dde5-47f0-a3d5-e0b2473d11ab" status: 200 len: 1092 microversion: 2.1 time: 0.112457 Jun 22 10:30:23.517318 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 407/789] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:30:23 2022] GET /compute/v2.1/servers/10d8ca63-dde5-47f0-a3d5-e0b2473d11ab => generated 1092 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:30:23.844422 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-0245b899-750e-478c-8e0d-c8b5e78b4e80 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:23.845108 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-0245b899-750e-478c-8e0d-c8b5e78b4e80 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:23.851673 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0245b899-750e-478c-8e0d-c8b5e78b4e80 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:23.852125 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0245b899-750e-478c-8e0d-c8b5e78b4e80 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:23.852917 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0245b899-750e-478c-8e0d-c8b5e78b4e80 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:23.853344 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0245b899-750e-478c-8e0d-c8b5e78b4e80 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:24.081575 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-0245b899-750e-478c-8e0d-c8b5e78b4e80 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:24.091348 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-0245b899-750e-478c-8e0d-c8b5e78b4e80 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:24.093110 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-0245b899-750e-478c-8e0d-c8b5e78b4e80 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:24.094399 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-0245b899-750e-478c-8e0d-c8b5e78b4e80 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1723 microversion: 2.20 time: 0.253963 Jun 22 10:30:24.095052 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 383/790] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:30:23 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1723 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:30:24.545578 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-6add6de5-7bee-4037-b302-f1db76932710 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:24.546668 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-6add6de5-7bee-4037-b302-f1db76932710 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 10d8ca63-dde5-47f0-a3d5-e0b2473d11ab] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:24.558650 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6add6de5-7bee-4037-b302-f1db76932710 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:24.559416 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6add6de5-7bee-4037-b302-f1db76932710 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:24.560779 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6add6de5-7bee-4037-b302-f1db76932710 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:24.561558 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6add6de5-7bee-4037-b302-f1db76932710 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:24.668411 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-6add6de5-7bee-4037-b302-f1db76932710 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a394fc62e6a64a85b855bf2eb56b4b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a87feacfb84d6c9f7ea48f230753b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:24.679932 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-6add6de5-7bee-4037-b302-f1db76932710 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "GET /compute/v2.1/servers/10d8ca63-dde5-47f0-a3d5-e0b2473d11ab" status: 200 len: 1142 microversion: 2.1 time: 0.147232 Jun 22 10:30:24.680726 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 408/791] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:30:24 2022] GET /compute/v2.1/servers/10d8ca63-dde5-47f0-a3d5-e0b2473d11ab => generated 1142 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:30:25.127268 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-f3a5eec9-22c5-40a9-8f29-29f32c2bd790 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:25.128413 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-f3a5eec9-22c5-40a9-8f29-29f32c2bd790 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:25.141111 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f3a5eec9-22c5-40a9-8f29-29f32c2bd790 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:25.141901 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f3a5eec9-22c5-40a9-8f29-29f32c2bd790 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:25.143339 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f3a5eec9-22c5-40a9-8f29-29f32c2bd790 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:25.144105 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f3a5eec9-22c5-40a9-8f29-29f32c2bd790 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:25.324443 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-f3a5eec9-22c5-40a9-8f29-29f32c2bd790 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:25.335501 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-f3a5eec9-22c5-40a9-8f29-29f32c2bd790 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:25.339190 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-f3a5eec9-22c5-40a9-8f29-29f32c2bd790 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:25.340998 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-f3a5eec9-22c5-40a9-8f29-29f32c2bd790 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1723 microversion: 2.20 time: 0.222072 Jun 22 10:30:25.342188 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 384/792] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:30:25 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:30:25.700418 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-ff038408-4a8b-49eb-9f80-70a187e56bd9 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:25.701427 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-ff038408-4a8b-49eb-9f80-70a187e56bd9 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 10d8ca63-dde5-47f0-a3d5-e0b2473d11ab] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:25.710430 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ff038408-4a8b-49eb-9f80-70a187e56bd9 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:25.711171 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ff038408-4a8b-49eb-9f80-70a187e56bd9 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:25.712153 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ff038408-4a8b-49eb-9f80-70a187e56bd9 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:25.712725 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ff038408-4a8b-49eb-9f80-70a187e56bd9 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:25.804358 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-ff038408-4a8b-49eb-9f80-70a187e56bd9 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a394fc62e6a64a85b855bf2eb56b4b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a87feacfb84d6c9f7ea48f230753b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:25.819067 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-ff038408-4a8b-49eb-9f80-70a187e56bd9 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "GET /compute/v2.1/servers/10d8ca63-dde5-47f0-a3d5-e0b2473d11ab" status: 200 len: 1198 microversion: 2.1 time: 0.123829 Jun 22 10:30:25.819986 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 409/793] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:30:25 2022] GET /compute/v2.1/servers/10d8ca63-dde5-47f0-a3d5-e0b2473d11ab => generated 1198 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:30:26.370697 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-2e134884-2233-4430-ad24-f193e402b652 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:26.371509 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-2e134884-2233-4430-ad24-f193e402b652 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:26.379202 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2e134884-2233-4430-ad24-f193e402b652 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:26.379658 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2e134884-2233-4430-ad24-f193e402b652 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:26.380464 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2e134884-2233-4430-ad24-f193e402b652 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:26.380906 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2e134884-2233-4430-ad24-f193e402b652 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:26.530925 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-2e134884-2233-4430-ad24-f193e402b652 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:26.539645 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-2e134884-2233-4430-ad24-f193e402b652 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:26.541170 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-2e134884-2233-4430-ad24-f193e402b652 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:26.542402 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-2e134884-2233-4430-ad24-f193e402b652 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1723 microversion: 2.20 time: 0.175919 Jun 22 10:30:26.543015 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 385/794] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:30:26 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:30:26.846369 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-34f46990-ed82-4ca3-a3d2-ff675a378c62 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:26.847292 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-34f46990-ed82-4ca3-a3d2-ff675a378c62 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 10d8ca63-dde5-47f0-a3d5-e0b2473d11ab] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:26.865896 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-34f46990-ed82-4ca3-a3d2-ff675a378c62 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:26.866284 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-34f46990-ed82-4ca3-a3d2-ff675a378c62 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:26.869301 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-34f46990-ed82-4ca3-a3d2-ff675a378c62 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:26.871239 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-34f46990-ed82-4ca3-a3d2-ff675a378c62 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:26.984269 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-34f46990-ed82-4ca3-a3d2-ff675a378c62 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a394fc62e6a64a85b855bf2eb56b4b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a87feacfb84d6c9f7ea48f230753b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:26.997825 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-34f46990-ed82-4ca3-a3d2-ff675a378c62 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "GET /compute/v2.1/servers/10d8ca63-dde5-47f0-a3d5-e0b2473d11ab" status: 200 len: 1208 microversion: 2.1 time: 0.155910 Jun 22 10:30:26.998896 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 410/795] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:30:26 2022] GET /compute/v2.1/servers/10d8ca63-dde5-47f0-a3d5-e0b2473d11ab => generated 1208 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:30:27.240924 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-7d41b125-8e50-4db3-afa3-fe5417578980 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8c2af206-2191-4b9f-84e2-82f03b685e2d"}} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:30:27.243738 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-7d41b125-8e50-4db3-afa3-fe5417578980 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: d02a6b26-3c65-44a5-8c06-88f9e38f30c7] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:27.259356 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7d41b125-8e50-4db3-afa3-fe5417578980 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:27.261871 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7d41b125-8e50-4db3-afa3-fe5417578980 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:27.263960 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7d41b125-8e50-4db3-afa3-fe5417578980 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:27.264901 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7d41b125-8e50-4db3-afa3-fe5417578980 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:27.446814 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.wsgi [None req-7d41b125-8e50-4db3-afa3-fe5417578980 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] HTTP exception thrown: Invalid volume: volume 8c2af206-2191-4b9f-84e2-82f03b685e2d is already attached to instances: d02a6b26-3c65-44a5-8c06-88f9e38f30c7 Jun 22 10:30:27.453665 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-7d41b125-8e50-4db3-afa3-fe5417578980 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Request method failure captured: Jun 22 10:30:27.453665 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: request: POST /compute/v2.1/servers/d02a6b26-3c65-44a5-8c06-88f9e38f30c7/os-volume_attachments HTTP/1.1 Jun 22 10:30:27.453665 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Accept: application/json Jun 22 10:30:27.453665 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Accept-Encoding: identity Jun 22 10:30:27.453665 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Connection: close Jun 22 10:30:27.453665 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Content-Length: 74 Jun 22 10:30:27.453665 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Content-Type: application/json Jun 22 10:30:27.453665 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Host: 10.222.0.66 Jun 22 10:30:27.453665 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Openstack-System-Scope: None Jun 22 10:30:27.453665 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: User-Agent: python-urllib3/1.26.9 Jun 22 10:30:27.453665 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Auth-Token: gAAAAABisu0Ck1QB2Lvyg9V3u3kBIuXEDJgkZ8XS4Rgzd5ukw0XPlYur1JC85E1WWEVd6k3S8eI6-t0Re7y4TmCuzTPaStOxInH_tNEfhxW9RG6_giYUrX4Dn5Ql7KnDFRmmntDTB2iztYRLelndnkJ5B_3DXuocSGsy72opKKw0vOKEx9YRw_Y Jun 22 10:30:27.453665 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Domain-Id: None Jun 22 10:30:27.453665 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Domain-Name: None Jun 22 10:30:27.453665 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Identity-Status: Confirmed Jun 22 10:30:27.453665 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Is-Admin-Project: True Jun 22 10:30:27.453665 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Domain-Id: default Jun 22 10:30:27.453665 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Domain-Name: Default Jun 22 10:30:27.453665 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Id: 1db3fe97f51f47a98da3cbc8f0d55741 Jun 22 10:30:27.453665 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Name: tempest-AttachVolumeNegativeTest-873283835 Jun 22 10:30:27.453665 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Role: member,reader Jun 22 10:30:27.453665 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Roles: member,reader Jun 22 10:30:27.456808 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_1db3fe97f51f47a98da3cbc8f0d55741"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1db3fe97f51f47a98da3cbc8f0d55741"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/1db3fe97f51f47a98da3cbc8f0d55741"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1db3fe97f51f47a98da3cbc8f0d55741"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}] Jun 22 10:30:27.456808 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Tenant: tempest-AttachVolumeNegativeTest-873283835 Jun 22 10:30:27.456808 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Tenant-Id: 1db3fe97f51f47a98da3cbc8f0d55741 Jun 22 10:30:27.456808 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-873283835 Jun 22 10:30:27.456808 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User: tempest-AttachVolumeNegativeTest-873283835-project Jun 22 10:30:27.456808 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Domain-Id: default Jun 22 10:30:27.456808 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Domain-Name: Default Jun 22 10:30:27.456808 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Id: da80b9a52feb462faf0469f2ab701fb8 Jun 22 10:30:27.456808 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Name: tempest-AttachVolumeNegativeTest-873283835-project Jun 22 10:30:27.456808 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Jun 22 10:30:27.456808 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: {"volumeAttachment": {"volumeId": "8c2af206-2191-4b9f-84e2-82f03b685e2d"}} Jun 22 10:30:27.456808 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: method: > Jun 22 10:30:27.458474 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: exception: Invalid volume: volume 8c2af206-2191-4b9f-84e2-82f03b685e2d is already attached to instances: d02a6b26-3c65-44a5-8c06-88f9e38f30c7 Jun 22 10:30:27.458474 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: action_args: {'server_id': 'd02a6b26-3c65-44a5-8c06-88f9e38f30c7', 'body': {'volumeAttachment': {'volumeId': '8c2af206-2191-4b9f-84e2-82f03b685e2d'}}} Jun 22 10:30:27.458474 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:30:27.458474 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:30:27.458474 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 22 10:30:27.458474 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 22 10:30:27.458474 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 22 10:30:27.458474 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 22 10:30:27.458474 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 22 10:30:27.458474 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 22 10:30:27.458474 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 22 10:30:27.458474 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 22 10:30:27.458474 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 22 10:30:27.458474 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 22 10:30:27.458474 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 8c2af206-2191-4b9f-84e2-82f03b685e2d is already attached to instances: d02a6b26-3c65-44a5-8c06-88f9e38f30c7 Jun 22 10:30:27.458474 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:30:27.458474 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:30:27.458474 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:30:27.458474 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:30:27.461528 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:30:27.461528 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:30:27.461528 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:30:27.461528 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:30:27.461528 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:30:27.461528 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:30:27.461528 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 10:30:27.461528 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 10:30:27.461528 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 10:30:27.461528 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 10:30:27.461528 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 22 10:30:27.461528 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 22 10:30:27.461528 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 22 10:30:27.461528 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 22 10:30:27.461528 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 8c2af206-2191-4b9f-84e2-82f03b685e2d is already attached to instances: d02a6b26-3c65-44a5-8c06-88f9e38f30c7 Jun 22 10:30:27.461528 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:30:27.461528 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:30:27.461528 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:30:27.461528 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:30:27.461528 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:30:27.465780 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:30:27.465780 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:30:27.465780 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:30:27.465780 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 8c2af206-2191-4b9f-84e2-82f03b685e2d is already attached to instances: d02a6b26-3c65-44a5-8c06-88f9e38f30c7 Jun 22 10:30:27.465780 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:30:27.467120 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-7d41b125-8e50-4db3-afa3-fe5417578980 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Returning 400 to user: Invalid volume: volume 8c2af206-2191-4b9f-84e2-82f03b685e2d is already attached to instances: d02a6b26-3c65-44a5-8c06-88f9e38f30c7 {{(pid=117679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:30:27.469222 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-7d41b125-8e50-4db3-afa3-fe5417578980 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "POST /compute/v2.1/servers/d02a6b26-3c65-44a5-8c06-88f9e38f30c7/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.237209 Jun 22 10:30:27.475415 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 386/796] 10.222.0.66 () {60 vars in 1322 bytes} [Wed Jun 22 10:30:27 2022] POST /compute/v2.1/servers/d02a6b26-3c65-44a5-8c06-88f9e38f30c7/os-volume_attachments => generated 174 bytes in 240 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 22 10:30:27.566549 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-0605feef-8b50-417a-b2dd-b90237e5527e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:27.569130 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-0605feef-8b50-417a-b2dd-b90237e5527e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:27.580162 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0605feef-8b50-417a-b2dd-b90237e5527e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:27.581026 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0605feef-8b50-417a-b2dd-b90237e5527e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:27.582553 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0605feef-8b50-417a-b2dd-b90237e5527e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:27.583375 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0605feef-8b50-417a-b2dd-b90237e5527e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:27.609513 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-9d4d1ad4-3d59-4494-9e25-883cfdbdc8f1 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:27.610605 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-9d4d1ad4-3d59-4494-9e25-883cfdbdc8f1 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: d02a6b26-3c65-44a5-8c06-88f9e38f30c7] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:27.621528 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9d4d1ad4-3d59-4494-9e25-883cfdbdc8f1 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:27.622330 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9d4d1ad4-3d59-4494-9e25-883cfdbdc8f1 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:27.624289 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9d4d1ad4-3d59-4494-9e25-883cfdbdc8f1 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:27.624907 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9d4d1ad4-3d59-4494-9e25-883cfdbdc8f1 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:27.762446 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.objects.instance [None req-9d4d1ad4-3d59-4494-9e25-883cfdbdc8f1 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lazy-loading 'services' on Instance uuid d02a6b26-3c65-44a5-8c06-88f9e38f30c7 {{(pid=117679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:30:27.910824 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-9d4d1ad4-3d59-4494-9e25-883cfdbdc8f1 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "DELETE /compute/v2.1/servers/d02a6b26-3c65-44a5-8c06-88f9e38f30c7/os-volume_attachments/8c2af206-2191-4b9f-84e2-82f03b685e2d" status: 202 len: 0 microversion: 2.1 time: 0.305563 Jun 22 10:30:27.912048 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 387/797] 10.222.0.66 () {58 vars in 1415 bytes} [Wed Jun 22 10:30:27 2022] DELETE /compute/v2.1/servers/d02a6b26-3c65-44a5-8c06-88f9e38f30c7/os-volume_attachments/8c2af206-2191-4b9f-84e2-82f03b685e2d => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 22 10:30:27.920025 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-0605feef-8b50-417a-b2dd-b90237e5527e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:27.930433 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-0605feef-8b50-417a-b2dd-b90237e5527e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:27.931888 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-b56ff83d-b271-4ee2-9257-06c004a28cfb tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:27.933978 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-b56ff83d-b271-4ee2-9257-06c004a28cfb tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: d02a6b26-3c65-44a5-8c06-88f9e38f30c7] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:27.939749 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-0605feef-8b50-417a-b2dd-b90237e5527e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:27.941272 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-0605feef-8b50-417a-b2dd-b90237e5527e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1723 microversion: 2.20 time: 0.383560 Jun 22 10:30:27.942381 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 411/798] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:30:27 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1723 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:30:27.964353 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b56ff83d-b271-4ee2-9257-06c004a28cfb tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:27.967783 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b56ff83d-b271-4ee2-9257-06c004a28cfb tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:27.969888 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b56ff83d-b271-4ee2-9257-06c004a28cfb tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:27.971058 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b56ff83d-b271-4ee2-9257-06c004a28cfb tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:28.027689 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-642534b7-e8c4-49d9-8ac4-0cbbd6fd3725 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:28.029006 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-642534b7-e8c4-49d9-8ac4-0cbbd6fd3725 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 10d8ca63-dde5-47f0-a3d5-e0b2473d11ab] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:28.045070 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-642534b7-e8c4-49d9-8ac4-0cbbd6fd3725 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:28.047313 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-642534b7-e8c4-49d9-8ac4-0cbbd6fd3725 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:28.049921 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-642534b7-e8c4-49d9-8ac4-0cbbd6fd3725 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:28.051786 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-b56ff83d-b271-4ee2-9257-06c004a28cfb tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/d02a6b26-3c65-44a5-8c06-88f9e38f30c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127787 Jun 22 10:30:28.052358 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-642534b7-e8c4-49d9-8ac4-0cbbd6fd3725 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:28.056190 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 388/799] 10.222.0.66 () {58 vars in 1301 bytes} [Wed Jun 22 10:30:27 2022] GET /compute/v2.1/servers/d02a6b26-3c65-44a5-8c06-88f9e38f30c7/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:30:28.389399 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-642534b7-e8c4-49d9-8ac4-0cbbd6fd3725 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a394fc62e6a64a85b855bf2eb56b4b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a87feacfb84d6c9f7ea48f230753b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:28.404822 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-642534b7-e8c4-49d9-8ac4-0cbbd6fd3725 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "GET /compute/v2.1/servers/10d8ca63-dde5-47f0-a3d5-e0b2473d11ab" status: 200 len: 1264 microversion: 2.1 time: 0.381934 Jun 22 10:30:28.406215 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 412/800] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:30:28 2022] GET /compute/v2.1/servers/10d8ca63-dde5-47f0-a3d5-e0b2473d11ab => generated 1264 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:30:28.913652 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-66e99b7c-d31f-47e2-94d3-d91caea091b4 req-4b93f88d-656c-40f0-a763-c6fc7ffd5585 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10d8ca63-dde5-47f0-a3d5-e0b2473d11ab", "tag": "a4a63615-2666-4669-8e9d-a427ca0e615a"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:30:28.955832 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-66e99b7c-d31f-47e2-94d3-d91caea091b4 req-4b93f88d-656c-40f0-a763-c6fc7ffd5585 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:28.957109 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-66e99b7c-d31f-47e2-94d3-d91caea091b4 req-4b93f88d-656c-40f0-a763-c6fc7ffd5585 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:28.975624 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-28144c36-f989-4c89-84fc-78e53c83f1b6 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:28.978429 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-28144c36-f989-4c89-84fc-78e53c83f1b6 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:28.993692 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-28144c36-f989-4c89-84fc-78e53c83f1b6 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:28.994960 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-28144c36-f989-4c89-84fc-78e53c83f1b6 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:28.997448 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-66e99b7c-d31f-47e2-94d3-d91caea091b4 req-4b93f88d-656c-40f0-a763-c6fc7ffd5585 service nova] Creating event network-changed:a4a63615-2666-4669-8e9d-a427ca0e615a for instance 10d8ca63-dde5-47f0-a3d5-e0b2473d11ab on hv-cinder-84713 Jun 22 10:30:28.998273 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-28144c36-f989-4c89-84fc-78e53c83f1b6 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:28.999468 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-28144c36-f989-4c89-84fc-78e53c83f1b6 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:29.007589 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-66e99b7c-d31f-47e2-94d3-d91caea091b4 req-4b93f88d-656c-40f0-a763-c6fc7ffd5585 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101968 Jun 22 10:30:29.009962 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 389/801] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:30:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:30:29.068097 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-64b3ba54-3d76-48cc-8657-6860524caf92 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:29.070100 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-64b3ba54-3d76-48cc-8657-6860524caf92 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: d02a6b26-3c65-44a5-8c06-88f9e38f30c7] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:29.079374 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-64b3ba54-3d76-48cc-8657-6860524caf92 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:29.080230 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-64b3ba54-3d76-48cc-8657-6860524caf92 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:29.081522 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-64b3ba54-3d76-48cc-8657-6860524caf92 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:29.081973 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-64b3ba54-3d76-48cc-8657-6860524caf92 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:29.159397 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-64b3ba54-3d76-48cc-8657-6860524caf92 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/d02a6b26-3c65-44a5-8c06-88f9e38f30c7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.088886 Jun 22 10:30:29.160848 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 390/802] 10.222.0.66 () {58 vars in 1301 bytes} [Wed Jun 22 10:30:29 2022] GET /compute/v2.1/servers/d02a6b26-3c65-44a5-8c06-88f9e38f30c7/os-volume_attachments => generated 25 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 22 10:30:29.270534 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-62dca763-e2e3-41ad-81df-e97a7c72e178 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:29.271110 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-62dca763-e2e3-41ad-81df-e97a7c72e178 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: d02a6b26-3c65-44a5-8c06-88f9e38f30c7] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:29.289575 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-62dca763-e2e3-41ad-81df-e97a7c72e178 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:29.290593 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-62dca763-e2e3-41ad-81df-e97a7c72e178 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:29.292999 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-62dca763-e2e3-41ad-81df-e97a7c72e178 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:29.293461 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-62dca763-e2e3-41ad-81df-e97a7c72e178 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:29.328675 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-28144c36-f989-4c89-84fc-78e53c83f1b6 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:29.331602 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-62dca763-e2e3-41ad-81df-e97a7c72e178 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: d02a6b26-3c65-44a5-8c06-88f9e38f30c7] Going to try to terminate instance {{(pid=117679) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 10:30:29.347981 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-28144c36-f989-4c89-84fc-78e53c83f1b6 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:29.351365 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-28144c36-f989-4c89-84fc-78e53c83f1b6 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:29.356564 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-28144c36-f989-4c89-84fc-78e53c83f1b6 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1723 microversion: 2.20 time: 0.386971 Jun 22 10:30:29.363667 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 413/803] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:30:28 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1723 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:30:29.435855 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-32e764ac-f6ae-40ed-88fd-b5abe4046140 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:29.436511 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-32e764ac-f6ae-40ed-88fd-b5abe4046140 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 10d8ca63-dde5-47f0-a3d5-e0b2473d11ab] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:29.445853 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:29.451807 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-32e764ac-f6ae-40ed-88fd-b5abe4046140 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:29.452527 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-32e764ac-f6ae-40ed-88fd-b5abe4046140 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:29.453387 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-32e764ac-f6ae-40ed-88fd-b5abe4046140 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:29.453837 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-32e764ac-f6ae-40ed-88fd-b5abe4046140 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:29.539782 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-62dca763-e2e3-41ad-81df-e97a7c72e178 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "DELETE /compute/v2.1/servers/d02a6b26-3c65-44a5-8c06-88f9e38f30c7" status: 204 len: 0 microversion: 2.1 time: 0.278275 Jun 22 10:30:29.541003 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 391/804] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Jun 22 10:30:29 2022] DELETE /compute/v2.1/servers/d02a6b26-3c65-44a5-8c06-88f9e38f30c7 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 10:30:29.553337 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-b3bded8c-3c92-40d9-875c-210e42b9c4e1 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:29.557919 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-b3bded8c-3c92-40d9-875c-210e42b9c4e1 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: d02a6b26-3c65-44a5-8c06-88f9e38f30c7] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:29.573067 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b3bded8c-3c92-40d9-875c-210e42b9c4e1 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:29.573067 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b3bded8c-3c92-40d9-875c-210e42b9c4e1 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:29.573067 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b3bded8c-3c92-40d9-875c-210e42b9c4e1 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:29.573697 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b3bded8c-3c92-40d9-875c-210e42b9c4e1 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:30.162976 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-32e764ac-f6ae-40ed-88fd-b5abe4046140 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a394fc62e6a64a85b855bf2eb56b4b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a87feacfb84d6c9f7ea48f230753b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:30.165343 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-b3bded8c-3c92-40d9-875c-210e42b9c4e1 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:30.175189 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-b3bded8c-3c92-40d9-875c-210e42b9c4e1 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/d02a6b26-3c65-44a5-8c06-88f9e38f30c7" status: 200 len: 1682 microversion: 2.1 time: 0.627479 Jun 22 10:30:30.175809 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 392/805] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:30:29 2022] GET /compute/v2.1/servers/d02a6b26-3c65-44a5-8c06-88f9e38f30c7 => generated 1682 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:30:30.181735 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-32e764ac-f6ae-40ed-88fd-b5abe4046140 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "GET /compute/v2.1/servers/10d8ca63-dde5-47f0-a3d5-e0b2473d11ab" status: 200 len: 1264 microversion: 2.1 time: 0.751844 Jun 22 10:30:30.183040 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 414/806] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:30:29 2022] GET /compute/v2.1/servers/10d8ca63-dde5-47f0-a3d5-e0b2473d11ab => generated 1264 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:30:30.388684 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-310c8b93-30ec-4e4f-9620-855f789249d6 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:30.389780 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-310c8b93-30ec-4e4f-9620-855f789249d6 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:30.400736 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-310c8b93-30ec-4e4f-9620-855f789249d6 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:30.401543 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-310c8b93-30ec-4e4f-9620-855f789249d6 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:30.403332 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-310c8b93-30ec-4e4f-9620-855f789249d6 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:30.405409 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-310c8b93-30ec-4e4f-9620-855f789249d6 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:30.607222 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-310c8b93-30ec-4e4f-9620-855f789249d6 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:30.616434 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-310c8b93-30ec-4e4f-9620-855f789249d6 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:30.618551 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-310c8b93-30ec-4e4f-9620-855f789249d6 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:30.619366 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-310c8b93-30ec-4e4f-9620-855f789249d6 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1723 microversion: 2.20 time: 0.236671 Jun 22 10:30:30.620377 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 393/807] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:30:30 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1723 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:30:31.204350 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-06e6d062-232b-4544-af29-7d2f35be700b tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:31.205250 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-06e6d062-232b-4544-af29-7d2f35be700b tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: d02a6b26-3c65-44a5-8c06-88f9e38f30c7] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:31.207364 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-073ab365-5006-424c-9591-2a982512a169 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:31.208586 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-073ab365-5006-424c-9591-2a982512a169 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 10d8ca63-dde5-47f0-a3d5-e0b2473d11ab] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:31.216410 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-06e6d062-232b-4544-af29-7d2f35be700b tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:31.217133 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-06e6d062-232b-4544-af29-7d2f35be700b tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:31.218448 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-06e6d062-232b-4544-af29-7d2f35be700b tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:31.219190 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-06e6d062-232b-4544-af29-7d2f35be700b tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:31.219326 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-073ab365-5006-424c-9591-2a982512a169 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:31.220031 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-073ab365-5006-424c-9591-2a982512a169 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:31.221288 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-073ab365-5006-424c-9591-2a982512a169 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:31.221998 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-073ab365-5006-424c-9591-2a982512a169 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:31.456259 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-073ab365-5006-424c-9591-2a982512a169 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a394fc62e6a64a85b855bf2eb56b4b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a87feacfb84d6c9f7ea48f230753b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:31.464251 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-06e6d062-232b-4544-af29-7d2f35be700b tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:31.465811 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-073ab365-5006-424c-9591-2a982512a169 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "GET /compute/v2.1/servers/10d8ca63-dde5-47f0-a3d5-e0b2473d11ab" status: 200 len: 1264 microversion: 2.1 time: 0.265206 Jun 22 10:30:31.466594 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 394/808] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:30:31 2022] GET /compute/v2.1/servers/10d8ca63-dde5-47f0-a3d5-e0b2473d11ab => generated 1264 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:30:31.472813 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-06e6d062-232b-4544-af29-7d2f35be700b tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/d02a6b26-3c65-44a5-8c06-88f9e38f30c7" status: 200 len: 1682 microversion: 2.1 time: 0.274954 Jun 22 10:30:31.473915 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 415/809] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:30:31 2022] GET /compute/v2.1/servers/d02a6b26-3c65-44a5-8c06-88f9e38f30c7 => generated 1682 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:30:31.648484 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-f4a2a02e-a433-4821-ab91-b820758eb47f tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:31.649105 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-f4a2a02e-a433-4821-ab91-b820758eb47f tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:31.656337 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f4a2a02e-a433-4821-ab91-b820758eb47f tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:31.656801 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f4a2a02e-a433-4821-ab91-b820758eb47f tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:31.657702 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f4a2a02e-a433-4821-ab91-b820758eb47f tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:31.658143 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f4a2a02e-a433-4821-ab91-b820758eb47f tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:31.805462 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-f4a2a02e-a433-4821-ab91-b820758eb47f tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:31.814794 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-f4a2a02e-a433-4821-ab91-b820758eb47f tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:31.816373 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-f4a2a02e-a433-4821-ab91-b820758eb47f tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:31.817603 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-f4a2a02e-a433-4821-ab91-b820758eb47f tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1723 microversion: 2.20 time: 0.173366 Jun 22 10:30:31.818179 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 395/810] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:30:31 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:30:32.483701 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-6e5fde09-0fd6-4dfa-a0e8-944f8a08d2a0 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:32.484455 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-6e5fde09-0fd6-4dfa-a0e8-944f8a08d2a0 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 10d8ca63-dde5-47f0-a3d5-e0b2473d11ab] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:32.492607 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-281af270-7951-401a-9fb9-63b71be327ee tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:32.493489 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6e5fde09-0fd6-4dfa-a0e8-944f8a08d2a0 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:32.493489 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6e5fde09-0fd6-4dfa-a0e8-944f8a08d2a0 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:32.493885 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-281af270-7951-401a-9fb9-63b71be327ee tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: d02a6b26-3c65-44a5-8c06-88f9e38f30c7] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:32.494190 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6e5fde09-0fd6-4dfa-a0e8-944f8a08d2a0 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:32.494547 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6e5fde09-0fd6-4dfa-a0e8-944f8a08d2a0 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:32.497379 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_cell0:SELECT=2 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:32.498199 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_cell0:SELECT=6 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:32.505880 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-281af270-7951-401a-9fb9-63b71be327ee tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:32.506588 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-281af270-7951-401a-9fb9-63b71be327ee tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:32.507834 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-281af270-7951-401a-9fb9-63b71be327ee tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:32.508576 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-281af270-7951-401a-9fb9-63b71be327ee tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:33.077192 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-281af270-7951-401a-9fb9-63b71be327ee tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:33.086389 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-6e5fde09-0fd6-4dfa-a0e8-944f8a08d2a0 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a394fc62e6a64a85b855bf2eb56b4b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a87feacfb84d6c9f7ea48f230753b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:33.090809 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-281af270-7951-401a-9fb9-63b71be327ee tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/d02a6b26-3c65-44a5-8c06-88f9e38f30c7" status: 200 len: 1682 microversion: 2.1 time: 0.602587 Jun 22 10:30:33.091748 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 396/811] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:30:32 2022] GET /compute/v2.1/servers/d02a6b26-3c65-44a5-8c06-88f9e38f30c7 => generated 1682 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:30:33.093573 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:33.100698 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-8f675ea4-b6df-41b1-83b0-71e24ab85dff tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:33.101675 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-8f675ea4-b6df-41b1-83b0-71e24ab85dff tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:33.102701 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-6e5fde09-0fd6-4dfa-a0e8-944f8a08d2a0 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "GET /compute/v2.1/servers/10d8ca63-dde5-47f0-a3d5-e0b2473d11ab" status: 200 len: 1264 microversion: 2.1 time: 0.622627 Jun 22 10:30:33.103656 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 416/812] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:30:32 2022] GET /compute/v2.1/servers/10d8ca63-dde5-47f0-a3d5-e0b2473d11ab => generated 1264 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:30:33.111164 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8f675ea4-b6df-41b1-83b0-71e24ab85dff tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:33.112147 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8f675ea4-b6df-41b1-83b0-71e24ab85dff tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:33.113272 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8f675ea4-b6df-41b1-83b0-71e24ab85dff tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:33.113984 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8f675ea4-b6df-41b1-83b0-71e24ab85dff tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:33.534112 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-8f675ea4-b6df-41b1-83b0-71e24ab85dff tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:33.546327 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-8f675ea4-b6df-41b1-83b0-71e24ab85dff tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:33.549892 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-8f675ea4-b6df-41b1-83b0-71e24ab85dff tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:33.552195 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-8f675ea4-b6df-41b1-83b0-71e24ab85dff tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1744 microversion: 2.20 time: 0.458489 Jun 22 10:30:33.553205 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 397/813] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:30:33 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1744 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:30:34.112575 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-ad4861bb-25c5-47ce-b638-87b53d2fdb94 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:34.113465 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-ad4861bb-25c5-47ce-b638-87b53d2fdb94 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: d02a6b26-3c65-44a5-8c06-88f9e38f30c7] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:34.117830 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell0:SELECT=4 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:34.128568 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ad4861bb-25c5-47ce-b638-87b53d2fdb94 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:34.129279 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ad4861bb-25c5-47ce-b638-87b53d2fdb94 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:34.131215 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ad4861bb-25c5-47ce-b638-87b53d2fdb94 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:34.132025 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ad4861bb-25c5-47ce-b638-87b53d2fdb94 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:34.133887 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-81cbf422-75f7-4737-9ef9-22d4b1edb4c6 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:34.134934 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-81cbf422-75f7-4737-9ef9-22d4b1edb4c6 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 10d8ca63-dde5-47f0-a3d5-e0b2473d11ab] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:34.146023 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-81cbf422-75f7-4737-9ef9-22d4b1edb4c6 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:34.146766 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-81cbf422-75f7-4737-9ef9-22d4b1edb4c6 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:34.148019 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-81cbf422-75f7-4737-9ef9-22d4b1edb4c6 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:34.148934 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-81cbf422-75f7-4737-9ef9-22d4b1edb4c6 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:34.378076 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-ad4861bb-25c5-47ce-b638-87b53d2fdb94 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:34.390646 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-ad4861bb-25c5-47ce-b638-87b53d2fdb94 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/d02a6b26-3c65-44a5-8c06-88f9e38f30c7" status: 200 len: 1682 microversion: 2.1 time: 0.283655 Jun 22 10:30:34.392239 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 417/814] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:30:34 2022] GET /compute/v2.1/servers/d02a6b26-3c65-44a5-8c06-88f9e38f30c7 => generated 1682 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:30:34.412122 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-81cbf422-75f7-4737-9ef9-22d4b1edb4c6 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a394fc62e6a64a85b855bf2eb56b4b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a87feacfb84d6c9f7ea48f230753b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:34.423475 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-81cbf422-75f7-4737-9ef9-22d4b1edb4c6 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "GET /compute/v2.1/servers/10d8ca63-dde5-47f0-a3d5-e0b2473d11ab" status: 200 len: 1264 microversion: 2.1 time: 0.296510 Jun 22 10:30:34.424245 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 398/815] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:30:34 2022] GET /compute/v2.1/servers/10d8ca63-dde5-47f0-a3d5-e0b2473d11ab => generated 1264 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:30:34.589800 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-6d0694da-840b-4075-adda-2ff3ea5259e5 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:34.591667 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-6d0694da-840b-4075-adda-2ff3ea5259e5 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:34.605640 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6d0694da-840b-4075-adda-2ff3ea5259e5 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:34.608020 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6d0694da-840b-4075-adda-2ff3ea5259e5 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:34.609819 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6d0694da-840b-4075-adda-2ff3ea5259e5 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:34.611616 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6d0694da-840b-4075-adda-2ff3ea5259e5 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:34.910141 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-6d0694da-840b-4075-adda-2ff3ea5259e5 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:34.926548 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-6d0694da-840b-4075-adda-2ff3ea5259e5 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:34.929545 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-6d0694da-840b-4075-adda-2ff3ea5259e5 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:34.931726 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-6d0694da-840b-4075-adda-2ff3ea5259e5 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1744 microversion: 2.20 time: 0.352416 Jun 22 10:30:34.932629 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 418/816] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:30:34 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1744 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:30:35.419572 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-c15f2832-07c6-41cb-85be-d21c85b927cf tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:35.420407 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-c15f2832-07c6-41cb-85be-d21c85b927cf tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: d02a6b26-3c65-44a5-8c06-88f9e38f30c7] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:35.427581 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c15f2832-07c6-41cb-85be-d21c85b927cf tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:35.428397 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c15f2832-07c6-41cb-85be-d21c85b927cf tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:35.429261 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c15f2832-07c6-41cb-85be-d21c85b927cf tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:35.429760 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c15f2832-07c6-41cb-85be-d21c85b927cf tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:35.444330 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-a766c40f-4ea0-4cbd-bc74-89b5809e8ebb tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:35.445306 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-a766c40f-4ea0-4cbd-bc74-89b5809e8ebb tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 10d8ca63-dde5-47f0-a3d5-e0b2473d11ab] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:35.454554 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a766c40f-4ea0-4cbd-bc74-89b5809e8ebb tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:35.455082 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a766c40f-4ea0-4cbd-bc74-89b5809e8ebb tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:35.456097 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a766c40f-4ea0-4cbd-bc74-89b5809e8ebb tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:35.456817 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a766c40f-4ea0-4cbd-bc74-89b5809e8ebb tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:35.587788 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-c15f2832-07c6-41cb-85be-d21c85b927cf tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:35.602121 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-c15f2832-07c6-41cb-85be-d21c85b927cf tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/d02a6b26-3c65-44a5-8c06-88f9e38f30c7" status: 200 len: 1614 microversion: 2.1 time: 0.187122 Jun 22 10:30:35.623981 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 399/817] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:30:35 2022] GET /compute/v2.1/servers/d02a6b26-3c65-44a5-8c06-88f9e38f30c7 => generated 1614 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:30:35.680188 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-a766c40f-4ea0-4cbd-bc74-89b5809e8ebb tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a394fc62e6a64a85b855bf2eb56b4b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a87feacfb84d6c9f7ea48f230753b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:35.693805 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-a766c40f-4ea0-4cbd-bc74-89b5809e8ebb tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "GET /compute/v2.1/servers/10d8ca63-dde5-47f0-a3d5-e0b2473d11ab" status: 200 len: 1264 microversion: 2.1 time: 0.255087 Jun 22 10:30:35.695406 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 419/818] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:30:35 2022] GET /compute/v2.1/servers/10d8ca63-dde5-47f0-a3d5-e0b2473d11ab => generated 1264 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:30:35.885557 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-ffd92daa-d076-445e-9cad-71f95d626696 req-0bf8615e-8671-4188-83fd-871bd7bfb444 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d02a6b26-3c65-44a5-8c06-88f9e38f30c7", "name": "network-vif-deleted", "tag": "8133c601-129a-4ea3-a1d7-c165a1a07276"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:30:35.927218 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-ffd92daa-d076-445e-9cad-71f95d626696 req-0bf8615e-8671-4188-83fd-871bd7bfb444 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:35.927958 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-ffd92daa-d076-445e-9cad-71f95d626696 req-0bf8615e-8671-4188-83fd-871bd7bfb444 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:35.960731 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-a5656488-bdaf-445a-8270-a1390eb9d92a tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:35.961767 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-a5656488-bdaf-445a-8270-a1390eb9d92a tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:35.962957 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-ffd92daa-d076-445e-9cad-71f95d626696 req-0bf8615e-8671-4188-83fd-871bd7bfb444 service nova] Creating event network-vif-deleted:8133c601-129a-4ea3-a1d7-c165a1a07276 for instance d02a6b26-3c65-44a5-8c06-88f9e38f30c7 on hv-cinder-84713 Jun 22 10:30:35.976105 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a5656488-bdaf-445a-8270-a1390eb9d92a tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:35.976743 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a5656488-bdaf-445a-8270-a1390eb9d92a tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:35.977971 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-ffd92daa-d076-445e-9cad-71f95d626696 req-0bf8615e-8671-4188-83fd-871bd7bfb444 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100881 Jun 22 10:30:35.978376 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a5656488-bdaf-445a-8270-a1390eb9d92a tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:35.978901 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a5656488-bdaf-445a-8270-a1390eb9d92a tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:35.989651 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 400/819] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:30:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:30:36.191923 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-a5656488-bdaf-445a-8270-a1390eb9d92a tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:36.208896 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-a5656488-bdaf-445a-8270-a1390eb9d92a tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:36.212194 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-a5656488-bdaf-445a-8270-a1390eb9d92a tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:36.214559 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-a5656488-bdaf-445a-8270-a1390eb9d92a tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1744 microversion: 2.20 time: 0.261072 Jun 22 10:30:36.215809 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 420/820] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:30:35 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1744 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:30:36.633747 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-589ba8fa-2711-409a-92ae-c8d2cd2c59d7 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:36.634640 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-589ba8fa-2711-409a-92ae-c8d2cd2c59d7 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: d02a6b26-3c65-44a5-8c06-88f9e38f30c7] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:36.644681 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-589ba8fa-2711-409a-92ae-c8d2cd2c59d7 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:36.645250 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-589ba8fa-2711-409a-92ae-c8d2cd2c59d7 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:36.646489 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-589ba8fa-2711-409a-92ae-c8d2cd2c59d7 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:36.647074 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-589ba8fa-2711-409a-92ae-c8d2cd2c59d7 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:36.665952 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.wsgi [None req-589ba8fa-2711-409a-92ae-c8d2cd2c59d7 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] HTTP exception thrown: Instance d02a6b26-3c65-44a5-8c06-88f9e38f30c7 could not be found. Jun 22 10:30:36.667741 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-589ba8fa-2711-409a-92ae-c8d2cd2c59d7 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Request method failure captured: Jun 22 10:30:36.667741 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: request: GET /compute/v2.1/servers/d02a6b26-3c65-44a5-8c06-88f9e38f30c7 HTTP/1.1 Jun 22 10:30:36.667741 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Accept: application/json Jun 22 10:30:36.667741 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Accept-Encoding: identity Jun 22 10:30:36.667741 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Connection: close Jun 22 10:30:36.667741 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Content-Length: 0 Jun 22 10:30:36.667741 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Content-Type: application/json Jun 22 10:30:36.667741 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Host: 10.222.0.66 Jun 22 10:30:36.667741 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Openstack-System-Scope: None Jun 22 10:30:36.667741 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: User-Agent: python-urllib3/1.26.9 Jun 22 10:30:36.667741 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Auth-Token: gAAAAABisu0Ck1QB2Lvyg9V3u3kBIuXEDJgkZ8XS4Rgzd5ukw0XPlYur1JC85E1WWEVd6k3S8eI6-t0Re7y4TmCuzTPaStOxInH_tNEfhxW9RG6_giYUrX4Dn5Ql7KnDFRmmntDTB2iztYRLelndnkJ5B_3DXuocSGsy72opKKw0vOKEx9YRw_Y Jun 22 10:30:36.667741 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Domain-Id: None Jun 22 10:30:36.667741 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Domain-Name: None Jun 22 10:30:36.667741 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Identity-Status: Confirmed Jun 22 10:30:36.667741 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Is-Admin-Project: True Jun 22 10:30:36.667741 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Domain-Id: default Jun 22 10:30:36.667741 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Domain-Name: Default Jun 22 10:30:36.667741 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Id: 1db3fe97f51f47a98da3cbc8f0d55741 Jun 22 10:30:36.667741 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Name: tempest-AttachVolumeNegativeTest-873283835 Jun 22 10:30:36.667741 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Role: member,reader Jun 22 10:30:36.667741 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Roles: member,reader Jun 22 10:30:36.670261 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_1db3fe97f51f47a98da3cbc8f0d55741"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1db3fe97f51f47a98da3cbc8f0d55741"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/1db3fe97f51f47a98da3cbc8f0d55741"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1db3fe97f51f47a98da3cbc8f0d55741"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}] Jun 22 10:30:36.670261 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Tenant: tempest-AttachVolumeNegativeTest-873283835 Jun 22 10:30:36.670261 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Tenant-Id: 1db3fe97f51f47a98da3cbc8f0d55741 Jun 22 10:30:36.670261 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-873283835 Jun 22 10:30:36.670261 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User: tempest-AttachVolumeNegativeTest-873283835-project Jun 22 10:30:36.670261 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Domain-Id: default Jun 22 10:30:36.670261 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Domain-Name: Default Jun 22 10:30:36.670261 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Id: da80b9a52feb462faf0469f2ab701fb8 Jun 22 10:30:36.670261 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Name: tempest-AttachVolumeNegativeTest-873283835-project Jun 22 10:30:36.670261 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: method: > Jun 22 10:30:36.670261 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: exception: Instance d02a6b26-3c65-44a5-8c06-88f9e38f30c7 could not be found. Jun 22 10:30:36.670261 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: action_args: {'id': 'd02a6b26-3c65-44a5-8c06-88f9e38f30c7'} Jun 22 10:30:36.671901 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:30:36.671901 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:30:36.671901 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:30:36.671901 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:30:36.671901 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:30:36.671901 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:30:36.671901 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:30:36.671901 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:30:36.671901 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:30:36.671901 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:30:36.671901 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d02a6b26-3c65-44a5-8c06-88f9e38f30c7 could not be found. Jun 22 10:30:36.671901 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:30:36.671901 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:30:36.671901 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:30:36.671901 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:30:36.671901 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:30:36.671901 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:30:36.671901 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:30:36.671901 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:30:36.671901 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:30:36.674720 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:30:36.674720 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:30:36.674720 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:30:36.674720 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:30:36.674720 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:30:36.674720 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:30:36.674720 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:30:36.674720 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d02a6b26-3c65-44a5-8c06-88f9e38f30c7 could not be found. Jun 22 10:30:36.674720 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:30:36.674720 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:30:36.674720 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:30:36.674720 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:30:36.674720 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:30:36.674720 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:30:36.674720 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:30:36.674720 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:30:36.674720 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d02a6b26-3c65-44a5-8c06-88f9e38f30c7 could not be found. Jun 22 10:30:36.674720 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:30:36.676750 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-589ba8fa-2711-409a-92ae-c8d2cd2c59d7 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Returning 404 to user: Instance d02a6b26-3c65-44a5-8c06-88f9e38f30c7 could not be found. {{(pid=117679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:30:36.676750 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-589ba8fa-2711-409a-92ae-c8d2cd2c59d7 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/d02a6b26-3c65-44a5-8c06-88f9e38f30c7" status: 404 len: 111 microversion: 2.1 time: 0.041565 Jun 22 10:30:36.676750 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 401/821] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:30:36 2022] GET /compute/v2.1/servers/d02a6b26-3c65-44a5-8c06-88f9e38f30c7 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 22 10:30:36.682816 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-93d76816-ca58-42f6-8528-ce53537cdd9e tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '.version_select at 0x7f60d97160d0>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:36.717984 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-93d76816-ca58-42f6-8528-ce53537cdd9e tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-508853585" status: 202 len: 0 microversion: 2.1 time: 0.042329 Jun 22 10:30:36.720226 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-c889592e-0db1-482a-b608-c753b131071d tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:36.721779 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-c889592e-0db1-482a-b608-c753b131071d tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 10d8ca63-dde5-47f0-a3d5-e0b2473d11ab] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:36.725130 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 421/822] 10.222.0.66 () {58 vars in 1217 bytes} [Wed Jun 22 10:30:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-508853585 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:30:36.735630 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c889592e-0db1-482a-b608-c753b131071d tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:36.736425 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c889592e-0db1-482a-b608-c753b131071d tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:36.737897 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c889592e-0db1-482a-b608-c753b131071d tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:36.738720 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c889592e-0db1-482a-b608-c753b131071d tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:37.005207 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-c889592e-0db1-482a-b608-c753b131071d tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a394fc62e6a64a85b855bf2eb56b4b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a87feacfb84d6c9f7ea48f230753b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:37.018857 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-c889592e-0db1-482a-b608-c753b131071d tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "GET /compute/v2.1/servers/10d8ca63-dde5-47f0-a3d5-e0b2473d11ab" status: 200 len: 1264 microversion: 2.1 time: 0.307893 Jun 22 10:30:37.019644 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 402/823] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:30:36 2022] GET /compute/v2.1/servers/10d8ca63-dde5-47f0-a3d5-e0b2473d11ab => generated 1264 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:30:37.244254 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-92494b00-7e69-4336-af4b-3f13cc56272c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:37.245355 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-92494b00-7e69-4336-af4b-3f13cc56272c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:37.263936 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-92494b00-7e69-4336-af4b-3f13cc56272c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:37.264731 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-92494b00-7e69-4336-af4b-3f13cc56272c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:37.266368 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-92494b00-7e69-4336-af4b-3f13cc56272c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:37.267217 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-92494b00-7e69-4336-af4b-3f13cc56272c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:37.511672 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-92494b00-7e69-4336-af4b-3f13cc56272c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:37.521806 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-92494b00-7e69-4336-af4b-3f13cc56272c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:37.526991 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-92494b00-7e69-4336-af4b-3f13cc56272c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:37.529355 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-92494b00-7e69-4336-af4b-3f13cc56272c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1744 microversion: 2.20 time: 0.293190 Jun 22 10:30:37.534918 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 422/824] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:30:37 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1744 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:30:37.869637 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-08f7f75c-099e-4f4e-8880-d6d86dc333e9 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Action: 'create', calling method: .version_select at 0x7f60d9ef6ca0>, body: {"keypair": {"name": "tempest-keypair-1261141106", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDu9Yit7ycLlpk3A32LAqwkghzp5TdtgttfD9oHb2mbVawEiSbntHswlBvXh3ULTTrR9wRz2r+fx9UoD3VtDUADx/rKa4HxVuYCcJpZd+2cQ6rfkqYtLyedHlO93xyXyFA=="}} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:30:37.885277 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.quota [None req-08f7f75c-099e-4f4e-8880-d6d86dc333e9 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Getting quotas for project 1db3fe97f51f47a98da3cbc8f0d55741. Resources: {'key_pairs'} {{(pid=117679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:30:37.890002 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.quota [None req-08f7f75c-099e-4f4e-8880-d6d86dc333e9 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Getting quotas for user da80b9a52feb462faf0469f2ab701fb8 and project 1db3fe97f51f47a98da3cbc8f0d55741. Resources: {'key_pairs'} {{(pid=117679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:30:37.916718 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-08f7f75c-099e-4f4e-8880-d6d86dc333e9 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051654 Jun 22 10:30:37.917422 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 403/825] 10.222.0.66 () {60 vars in 1158 bytes} [Wed Jun 22 10:30:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:30:38.043579 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-14ef6413-e26e-448c-9835-13cc25c2ac79 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:38.045937 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-14ef6413-e26e-448c-9835-13cc25c2ac79 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 10d8ca63-dde5-47f0-a3d5-e0b2473d11ab] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:38.061919 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-14ef6413-e26e-448c-9835-13cc25c2ac79 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:38.063084 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-14ef6413-e26e-448c-9835-13cc25c2ac79 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:38.064765 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-14ef6413-e26e-448c-9835-13cc25c2ac79 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:38.065607 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-14ef6413-e26e-448c-9835-13cc25c2ac79 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:38.287688 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-14ef6413-e26e-448c-9835-13cc25c2ac79 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a394fc62e6a64a85b855bf2eb56b4b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a87feacfb84d6c9f7ea48f230753b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:38.296210 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-14ef6413-e26e-448c-9835-13cc25c2ac79 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "GET /compute/v2.1/servers/10d8ca63-dde5-47f0-a3d5-e0b2473d11ab" status: 200 len: 1264 microversion: 2.1 time: 0.261029 Jun 22 10:30:38.296668 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 423/826] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:30:38 2022] GET /compute/v2.1/servers/10d8ca63-dde5-47f0-a3d5-e0b2473d11ab => generated 1264 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:30:38.553503 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-73750c69-f09f-4b9e-ae83-f6e22bda1ec2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:38.554413 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-73750c69-f09f-4b9e-ae83-f6e22bda1ec2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:38.562901 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-73750c69-f09f-4b9e-ae83-f6e22bda1ec2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:38.563703 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-73750c69-f09f-4b9e-ae83-f6e22bda1ec2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:38.564521 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-73750c69-f09f-4b9e-ae83-f6e22bda1ec2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:38.565131 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-73750c69-f09f-4b9e-ae83-f6e22bda1ec2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:38.792840 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-9b86a005-0d7f-4994-be4c-1dee3844dff9 req-ab513666-cbfc-4347-858a-0e080e003e05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d288ac1d-ffb9-4ac1-a5a4-095bf673cea0", "name": "network-vif-plugged", "status": "completed", "tag": "41f6ee40-8d5d-4ffb-b909-afe6a1d8f347"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:30:38.805618 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_api:SELECT=54,nova_api:DELETE=1 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:38.837424 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-9b86a005-0d7f-4994-be4c-1dee3844dff9 req-ab513666-cbfc-4347-858a-0e080e003e05 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:38.838286 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-9b86a005-0d7f-4994-be4c-1dee3844dff9 req-ab513666-cbfc-4347-858a-0e080e003e05 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:38.860233 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-73750c69-f09f-4b9e-ae83-f6e22bda1ec2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:38.862968 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-9b86a005-0d7f-4994-be4c-1dee3844dff9 req-ab513666-cbfc-4347-858a-0e080e003e05 service nova] Creating event network-vif-plugged:41f6ee40-8d5d-4ffb-b909-afe6a1d8f347 for instance d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 on hv-cinder-84713 Jun 22 10:30:38.872105 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-73750c69-f09f-4b9e-ae83-f6e22bda1ec2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:38.874489 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-73750c69-f09f-4b9e-ae83-f6e22bda1ec2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:38.875065 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-9b86a005-0d7f-4994-be4c-1dee3844dff9 req-ab513666-cbfc-4347-858a-0e080e003e05 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094575 Jun 22 10:30:38.876878 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-73750c69-f09f-4b9e-ae83-f6e22bda1ec2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1744 microversion: 2.20 time: 0.327530 Jun 22 10:30:38.877683 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 404/827] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:30:38 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1744 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:30:38.878373 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 424/828] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:30:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:30:39.318129 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-afe4acee-9029-43da-bd9a-b8b62b343440 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:39.319833 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-afe4acee-9029-43da-bd9a-b8b62b343440 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 10d8ca63-dde5-47f0-a3d5-e0b2473d11ab] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:39.326787 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:39.334948 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-afe4acee-9029-43da-bd9a-b8b62b343440 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:39.336148 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-afe4acee-9029-43da-bd9a-b8b62b343440 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:39.337972 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-afe4acee-9029-43da-bd9a-b8b62b343440 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:39.339079 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-afe4acee-9029-43da-bd9a-b8b62b343440 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:39.603815 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-afe4acee-9029-43da-bd9a-b8b62b343440 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a394fc62e6a64a85b855bf2eb56b4b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a87feacfb84d6c9f7ea48f230753b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:39.614282 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-afe4acee-9029-43da-bd9a-b8b62b343440 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "GET /compute/v2.1/servers/10d8ca63-dde5-47f0-a3d5-e0b2473d11ab" status: 200 len: 1264 microversion: 2.1 time: 0.304127 Jun 22 10:30:39.615109 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 405/829] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:30:39 2022] GET /compute/v2.1/servers/10d8ca63-dde5-47f0-a3d5-e0b2473d11ab => generated 1264 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:30:39.896904 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-62714b00-b16c-4680-a5d0-a1a5675ec97a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-446714314", "imageRef": "58addf50-5317-403a-beb0-4760bdbcaa13", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "09887ec6-fdf3-4f5d-9b2b-0fe6b3011cfb"}], "security_groups": [{"name": "tempest-securitygroup--947079028"}], "key_name": "tempest-keypair-1261141106", "user_data": "}} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:30:39.906203 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-2a173777-561e-4624-90b9-30e9d76e49e9 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:39.906971 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-2a173777-561e-4624-90b9-30e9d76e49e9 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:39.914279 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2a173777-561e-4624-90b9-30e9d76e49e9 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:39.914807 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2a173777-561e-4624-90b9-30e9d76e49e9 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:39.915621 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2a173777-561e-4624-90b9-30e9d76e49e9 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:39.916045 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2a173777-561e-4624-90b9-30e9d76e49e9 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:40.083782 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.network.neutron [None req-62714b00-b16c-4680-a5d0-a1a5675ec97a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] validate_networks() for [('09887ec6-fdf3-4f5d-9b2b-0fe6b3011cfb', None, None, None, None, None)] {{(pid=117680) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 10:30:40.154413 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-2a173777-561e-4624-90b9-30e9d76e49e9 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:40.165544 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-2a173777-561e-4624-90b9-30e9d76e49e9 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:40.167383 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-2a173777-561e-4624-90b9-30e9d76e49e9 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:40.168782 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-2a173777-561e-4624-90b9-30e9d76e49e9 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1744 microversion: 2.20 time: 0.267097 Jun 22 10:30:40.169369 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 406/830] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:30:39 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1744 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:30:40.569938 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-62714b00-b16c-4680-a5d0-a1a5675ec97a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Flavor limits 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 10:30:40.570448 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-62714b00-b16c-4680-a5d0-a1a5675ec97a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Image limits 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 10:30:40.570977 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-62714b00-b16c-4680-a5d0-a1a5675ec97a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Flavor pref 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 10:30:40.571389 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-62714b00-b16c-4680-a5d0-a1a5675ec97a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Image pref 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 10:30:40.571807 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-62714b00-b16c-4680-a5d0-a1a5675ec97a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 10:30:40.584481 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-62714b00-b16c-4680-a5d0-a1a5675ec97a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:40.585465 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-62714b00-b16c-4680-a5d0-a1a5675ec97a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:40.587036 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-62714b00-b16c-4680-a5d0-a1a5675ec97a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:40.587842 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-62714b00-b16c-4680-a5d0-a1a5675ec97a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:40.619106 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.quota [None req-62714b00-b16c-4680-a5d0-a1a5675ec97a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Getting quotas for project 1db3fe97f51f47a98da3cbc8f0d55741. Resources: {'instances', 'cores', 'ram'} {{(pid=117680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:30:40.628525 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.quota [None req-62714b00-b16c-4680-a5d0-a1a5675ec97a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Getting quotas for user da80b9a52feb462faf0469f2ab701fb8 and project 1db3fe97f51f47a98da3cbc8f0d55741. Resources: {'instances', 'cores', 'ram'} {{(pid=117680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:30:40.651622 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-32599f2c-4c8c-4dcb-aa56-a84e77b5f615 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:40.651817 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-62714b00-b16c-4680-a5d0-a1a5675ec97a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Going to run 1 instances... {{(pid=117680) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 10:30:40.653411 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-32599f2c-4c8c-4dcb-aa56-a84e77b5f615 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 10d8ca63-dde5-47f0-a3d5-e0b2473d11ab] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:40.656287 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-62714b00-b16c-4680-a5d0-a1a5675ec97a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: 43019934-5ced-4af9-81e5-d0373842bee0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58addf50-5317-403a-beb0-4760bdbcaa13',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 10:30:40.663787 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-32599f2c-4c8c-4dcb-aa56-a84e77b5f615 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:40.664873 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-32599f2c-4c8c-4dcb-aa56-a84e77b5f615 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:40.666275 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-32599f2c-4c8c-4dcb-aa56-a84e77b5f615 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:40.667007 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-32599f2c-4c8c-4dcb-aa56-a84e77b5f615 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:40.744870 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-62714b00-b16c-4680-a5d0-a1a5675ec97a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.857849 Jun 22 10:30:40.754703 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 425/831] 10.222.0.66 () {60 vars in 1146 bytes} [Wed Jun 22 10:30:39 2022] POST /compute/v2.1/servers => generated 401 bytes in 861 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 10:30:40.762699 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-0712ce4a-3a67-44dd-a529-080b63eede9f tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:40.763320 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-0712ce4a-3a67-44dd-a529-080b63eede9f tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: 43019934-5ced-4af9-81e5-d0373842bee0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:40.857475 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-0712ce4a-3a67-44dd-a529-080b63eede9f tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:40.867713 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-0712ce4a-3a67-44dd-a529-080b63eede9f tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/43019934-5ced-4af9-81e5-d0373842bee0" status: 200 len: 1241 microversion: 2.1 time: 0.110472 Jun 22 10:30:40.870907 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 426/832] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:30:40 2022] GET /compute/v2.1/servers/43019934-5ced-4af9-81e5-d0373842bee0 => generated 1241 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:30:40.878188 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-32599f2c-4c8c-4dcb-aa56-a84e77b5f615 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a394fc62e6a64a85b855bf2eb56b4b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a87feacfb84d6c9f7ea48f230753b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:40.886657 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-32599f2c-4c8c-4dcb-aa56-a84e77b5f615 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "GET /compute/v2.1/servers/10d8ca63-dde5-47f0-a3d5-e0b2473d11ab" status: 200 len: 1264 microversion: 2.1 time: 0.251624 Jun 22 10:30:40.894426 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 407/833] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:30:40 2022] GET /compute/v2.1/servers/10d8ca63-dde5-47f0-a3d5-e0b2473d11ab => generated 1264 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:30:40.903269 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-fde2380b-0613-4248-899c-a8ce8cde498d req-8052584f-9462-4acc-82dc-f4256a2b7f51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10d8ca63-dde5-47f0-a3d5-e0b2473d11ab", "name": "network-vif-plugged", "status": "completed", "tag": "a4a63615-2666-4669-8e9d-a427ca0e615a"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:30:40.920429 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-fde2380b-0613-4248-899c-a8ce8cde498d req-8052584f-9462-4acc-82dc-f4256a2b7f51 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:40.921201 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-fde2380b-0613-4248-899c-a8ce8cde498d req-8052584f-9462-4acc-82dc-f4256a2b7f51 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:40.942466 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-fde2380b-0613-4248-899c-a8ce8cde498d req-8052584f-9462-4acc-82dc-f4256a2b7f51 service nova] Creating event network-vif-plugged:a4a63615-2666-4669-8e9d-a427ca0e615a for instance 10d8ca63-dde5-47f0-a3d5-e0b2473d11ab on hv-cinder-84713 Jun 22 10:30:40.951568 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-fde2380b-0613-4248-899c-a8ce8cde498d req-8052584f-9462-4acc-82dc-f4256a2b7f51 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058876 Jun 22 10:30:40.953826 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 427/834] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:30:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:30:41.190999 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-8b243909-f871-42f1-981a-20d5cdd17200 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:41.192023 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-8b243909-f871-42f1-981a-20d5cdd17200 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:41.214568 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8b243909-f871-42f1-981a-20d5cdd17200 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:41.215340 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8b243909-f871-42f1-981a-20d5cdd17200 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:41.216169 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8b243909-f871-42f1-981a-20d5cdd17200 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:41.216610 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8b243909-f871-42f1-981a-20d5cdd17200 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:41.487363 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-8b243909-f871-42f1-981a-20d5cdd17200 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:41.500756 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-8b243909-f871-42f1-981a-20d5cdd17200 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:41.503794 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-8b243909-f871-42f1-981a-20d5cdd17200 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:41.505927 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-8b243909-f871-42f1-981a-20d5cdd17200 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1739 microversion: 2.20 time: 0.321669 Jun 22 10:30:41.526854 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 408/835] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:30:41 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1739 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:30:41.895466 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-71864bfe-7877-44a9-aecd-697dba4c84d3 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:41.897800 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-71864bfe-7877-44a9-aecd-697dba4c84d3 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: 43019934-5ced-4af9-81e5-d0373842bee0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:41.909172 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-d1a1f3c3-5680-4b3a-a18f-e584922303b5 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:41.910380 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-d1a1f3c3-5680-4b3a-a18f-e584922303b5 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 10d8ca63-dde5-47f0-a3d5-e0b2473d11ab] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:41.929332 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-71864bfe-7877-44a9-aecd-697dba4c84d3 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:41.931402 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-71864bfe-7877-44a9-aecd-697dba4c84d3 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:41.932926 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d1a1f3c3-5680-4b3a-a18f-e584922303b5 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:41.933294 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-71864bfe-7877-44a9-aecd-697dba4c84d3 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:41.934307 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d1a1f3c3-5680-4b3a-a18f-e584922303b5 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:41.935950 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d1a1f3c3-5680-4b3a-a18f-e584922303b5 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:41.936925 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d1a1f3c3-5680-4b3a-a18f-e584922303b5 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:41.939693 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-71864bfe-7877-44a9-aecd-697dba4c84d3 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:42.115198 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-71864bfe-7877-44a9-aecd-697dba4c84d3 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:42.131068 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-71864bfe-7877-44a9-aecd-697dba4c84d3 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/43019934-5ced-4af9-81e5-d0373842bee0" status: 200 len: 1293 microversion: 2.1 time: 0.248473 Jun 22 10:30:42.132660 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 428/836] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:30:41 2022] GET /compute/v2.1/servers/43019934-5ced-4af9-81e5-d0373842bee0 => generated 1293 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:30:42.280908 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-d1a1f3c3-5680-4b3a-a18f-e584922303b5 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a394fc62e6a64a85b855bf2eb56b4b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a87feacfb84d6c9f7ea48f230753b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:42.295379 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-d1a1f3c3-5680-4b3a-a18f-e584922303b5 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "GET /compute/v2.1/servers/10d8ca63-dde5-47f0-a3d5-e0b2473d11ab" status: 200 len: 1264 microversion: 2.1 time: 0.393096 Jun 22 10:30:42.296359 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 409/837] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:30:41 2022] GET /compute/v2.1/servers/10d8ca63-dde5-47f0-a3d5-e0b2473d11ab => generated 1264 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:30:42.543205 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-45a81bfb-f5de-4deb-83ee-2818b92e2608 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:42.544794 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-45a81bfb-f5de-4deb-83ee-2818b92e2608 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:42.557924 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-45a81bfb-f5de-4deb-83ee-2818b92e2608 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:42.559249 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-45a81bfb-f5de-4deb-83ee-2818b92e2608 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:42.561033 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-45a81bfb-f5de-4deb-83ee-2818b92e2608 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:42.562096 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-45a81bfb-f5de-4deb-83ee-2818b92e2608 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:42.757571 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-45a81bfb-f5de-4deb-83ee-2818b92e2608 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:42.775095 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-45a81bfb-f5de-4deb-83ee-2818b92e2608 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:42.776625 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-45a81bfb-f5de-4deb-83ee-2818b92e2608 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:42.778164 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-45a81bfb-f5de-4deb-83ee-2818b92e2608 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1739 microversion: 2.20 time: 0.243499 Jun 22 10:30:42.779173 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 429/838] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:30:42 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1739 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:30:43.156670 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-67c30c90-5daa-41da-a8aa-dc9cc7d47ac1 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:43.157687 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-67c30c90-5daa-41da-a8aa-dc9cc7d47ac1 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: 43019934-5ced-4af9-81e5-d0373842bee0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:43.165249 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-67c30c90-5daa-41da-a8aa-dc9cc7d47ac1 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:43.166399 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-67c30c90-5daa-41da-a8aa-dc9cc7d47ac1 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:43.167959 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-67c30c90-5daa-41da-a8aa-dc9cc7d47ac1 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:43.168619 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-67c30c90-5daa-41da-a8aa-dc9cc7d47ac1 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:43.199128 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:43.263976 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-67c30c90-5daa-41da-a8aa-dc9cc7d47ac1 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:43.276491 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-67c30c90-5daa-41da-a8aa-dc9cc7d47ac1 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/43019934-5ced-4af9-81e5-d0373842bee0" status: 200 len: 1301 microversion: 2.1 time: 0.123954 Jun 22 10:30:43.277820 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 410/839] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:30:43 2022] GET /compute/v2.1/servers/43019934-5ced-4af9-81e5-d0373842bee0 => generated 1301 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:30:43.324734 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-bd449e0f-1edf-47ee-bc31-d6a3ec8dc5b8 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:43.325369 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-bd449e0f-1edf-47ee-bc31-d6a3ec8dc5b8 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 10d8ca63-dde5-47f0-a3d5-e0b2473d11ab] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:43.332079 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-bd449e0f-1edf-47ee-bc31-d6a3ec8dc5b8 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:43.332836 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-bd449e0f-1edf-47ee-bc31-d6a3ec8dc5b8 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:43.333804 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-bd449e0f-1edf-47ee-bc31-d6a3ec8dc5b8 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:43.334568 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-bd449e0f-1edf-47ee-bc31-d6a3ec8dc5b8 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:43.676672 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-bd449e0f-1edf-47ee-bc31-d6a3ec8dc5b8 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a394fc62e6a64a85b855bf2eb56b4b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a87feacfb84d6c9f7ea48f230753b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:43.695579 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-bd449e0f-1edf-47ee-bc31-d6a3ec8dc5b8 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "GET /compute/v2.1/servers/10d8ca63-dde5-47f0-a3d5-e0b2473d11ab" status: 200 len: 1452 microversion: 2.1 time: 0.374779 Jun 22 10:30:43.696631 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 430/840] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:30:43 2022] GET /compute/v2.1/servers/10d8ca63-dde5-47f0-a3d5-e0b2473d11ab => generated 1452 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:30:43.728926 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-dc9f9902-20d5-4421-80b0-b95ea3879901 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:43.729978 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-dc9f9902-20d5-4421-80b0-b95ea3879901 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 10d8ca63-dde5-47f0-a3d5-e0b2473d11ab] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:43.739692 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-dc9f9902-20d5-4421-80b0-b95ea3879901 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:43.740509 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-dc9f9902-20d5-4421-80b0-b95ea3879901 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:43.741506 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-dc9f9902-20d5-4421-80b0-b95ea3879901 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:43.742114 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-dc9f9902-20d5-4421-80b0-b95ea3879901 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:43.799709 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-3aa911df-bd66-45a8-9f9d-85a0110ebc69 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:43.802319 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-3aa911df-bd66-45a8-9f9d-85a0110ebc69 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:43.824124 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3aa911df-bd66-45a8-9f9d-85a0110ebc69 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:43.824454 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3aa911df-bd66-45a8-9f9d-85a0110ebc69 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:43.825130 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3aa911df-bd66-45a8-9f9d-85a0110ebc69 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:43.831958 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3aa911df-bd66-45a8-9f9d-85a0110ebc69 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:44.184920 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-3aa911df-bd66-45a8-9f9d-85a0110ebc69 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:44.210534 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-3aa911df-bd66-45a8-9f9d-85a0110ebc69 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:44.211453 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-dc9f9902-20d5-4421-80b0-b95ea3879901 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a394fc62e6a64a85b855bf2eb56b4b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a87feacfb84d6c9f7ea48f230753b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:44.213748 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-3aa911df-bd66-45a8-9f9d-85a0110ebc69 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:44.216491 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-3aa911df-bd66-45a8-9f9d-85a0110ebc69 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1739 microversion: 2.20 time: 0.422822 Jun 22 10:30:44.218823 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 431/841] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:30:43 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1739 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:30:44.223578 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-dc9f9902-20d5-4421-80b0-b95ea3879901 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "GET /compute/v2.1/servers/10d8ca63-dde5-47f0-a3d5-e0b2473d11ab" status: 200 len: 1452 microversion: 2.1 time: 0.506256 Jun 22 10:30:44.224557 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 411/842] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:30:43 2022] GET /compute/v2.1/servers/10d8ca63-dde5-47f0-a3d5-e0b2473d11ab => generated 1452 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:30:44.299493 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-de8bdbd3-abeb-4c8b-95fe-913b8688884a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:44.304301 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-de8bdbd3-abeb-4c8b-95fe-913b8688884a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: 43019934-5ced-4af9-81e5-d0373842bee0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:44.328483 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-de8bdbd3-abeb-4c8b-95fe-913b8688884a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:44.340039 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-de8bdbd3-abeb-4c8b-95fe-913b8688884a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:44.341806 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-de8bdbd3-abeb-4c8b-95fe-913b8688884a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:44.342738 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-de8bdbd3-abeb-4c8b-95fe-913b8688884a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:44.488611 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-de8bdbd3-abeb-4c8b-95fe-913b8688884a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:44.506439 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-de8bdbd3-abeb-4c8b-95fe-913b8688884a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/43019934-5ced-4af9-81e5-d0373842bee0" status: 200 len: 1299 microversion: 2.1 time: 0.214285 Jun 22 10:30:44.508429 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 432/843] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:30:44 2022] GET /compute/v2.1/servers/43019934-5ced-4af9-81e5-d0373842bee0 => generated 1299 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:30:45.247287 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-1316418b-78b5-4f22-94c8-0dbf25b6cd20 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:45.248147 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-1316418b-78b5-4f22-94c8-0dbf25b6cd20 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:45.268397 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1316418b-78b5-4f22-94c8-0dbf25b6cd20 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:45.269928 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1316418b-78b5-4f22-94c8-0dbf25b6cd20 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:45.271944 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1316418b-78b5-4f22-94c8-0dbf25b6cd20 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:45.273160 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1316418b-78b5-4f22-94c8-0dbf25b6cd20 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:45.557025 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-97d3bd13-b39e-44d0-bf3a-7336624b54ef tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:45.557666 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-97d3bd13-b39e-44d0-bf3a-7336624b54ef tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: 43019934-5ced-4af9-81e5-d0373842bee0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:45.574977 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-97d3bd13-b39e-44d0-bf3a-7336624b54ef tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:45.575460 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-97d3bd13-b39e-44d0-bf3a-7336624b54ef tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:45.576477 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-97d3bd13-b39e-44d0-bf3a-7336624b54ef tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:45.576931 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-97d3bd13-b39e-44d0-bf3a-7336624b54ef tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:45.595306 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-1316418b-78b5-4f22-94c8-0dbf25b6cd20 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:45.614949 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-1316418b-78b5-4f22-94c8-0dbf25b6cd20 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:45.616979 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-1316418b-78b5-4f22-94c8-0dbf25b6cd20 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:45.619992 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-1316418b-78b5-4f22-94c8-0dbf25b6cd20 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1739 microversion: 2.20 time: 0.378223 Jun 22 10:30:45.628349 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 412/844] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:30:45 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1739 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:30:46.026357 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-0e81e611-9acd-4f51-9e18-4babb8c92e73 req-390c2071-5a43-4f99-a896-22ec260e40a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43019934-5ced-4af9-81e5-d0373842bee0", "tag": "0e25f1dd-b485-4c62-9076-a43bdc61b091"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:30:46.046715 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-0e81e611-9acd-4f51-9e18-4babb8c92e73 req-390c2071-5a43-4f99-a896-22ec260e40a0 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:46.056031 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-0e81e611-9acd-4f51-9e18-4babb8c92e73 req-390c2071-5a43-4f99-a896-22ec260e40a0 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:46.076324 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-0e81e611-9acd-4f51-9e18-4babb8c92e73 req-390c2071-5a43-4f99-a896-22ec260e40a0 service nova] Creating event network-changed:0e25f1dd-b485-4c62-9076-a43bdc61b091 for instance 43019934-5ced-4af9-81e5-d0373842bee0 on hv-cinder-84713 Jun 22 10:30:46.093865 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-0e81e611-9acd-4f51-9e18-4babb8c92e73 req-390c2071-5a43-4f99-a896-22ec260e40a0 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071814 Jun 22 10:30:46.095090 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 413/845] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:30:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:30:46.301422 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-97d3bd13-b39e-44d0-bf3a-7336624b54ef tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:46.318057 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-97d3bd13-b39e-44d0-bf3a-7336624b54ef tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/43019934-5ced-4af9-81e5-d0373842bee0" status: 200 len: 1366 microversion: 2.1 time: 0.766977 Jun 22 10:30:46.319007 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 433/846] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:30:45 2022] GET /compute/v2.1/servers/43019934-5ced-4af9-81e5-d0373842bee0 => generated 1366 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:30:46.956021 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-cd6ddee9-0dcf-46e9-95c4-948bee239ea1 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:46.957415 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-cd6ddee9-0dcf-46e9-95c4-948bee239ea1 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:46.972870 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-cd6ddee9-0dcf-46e9-95c4-948bee239ea1 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:46.974110 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-cd6ddee9-0dcf-46e9-95c4-948bee239ea1 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:46.975186 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-cd6ddee9-0dcf-46e9-95c4-948bee239ea1 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:46.975794 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-cd6ddee9-0dcf-46e9-95c4-948bee239ea1 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:47.338429 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-6478b208-17d4-4335-8cff-bd432120409d tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:47.339851 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-6478b208-17d4-4335-8cff-bd432120409d tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: 43019934-5ced-4af9-81e5-d0373842bee0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:47.346808 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6478b208-17d4-4335-8cff-bd432120409d tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:47.347551 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6478b208-17d4-4335-8cff-bd432120409d tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:47.348520 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6478b208-17d4-4335-8cff-bd432120409d tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:47.349123 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6478b208-17d4-4335-8cff-bd432120409d tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:47.602941 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-cd6ddee9-0dcf-46e9-95c4-948bee239ea1 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:47.650938 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-cd6ddee9-0dcf-46e9-95c4-948bee239ea1 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:47.665873 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-cd6ddee9-0dcf-46e9-95c4-948bee239ea1 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:47.668127 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-cd6ddee9-0dcf-46e9-95c4-948bee239ea1 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1739 microversion: 2.20 time: 1.027138 Jun 22 10:30:47.669900 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 414/847] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:30:46 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1739 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:30:47.903043 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-6478b208-17d4-4335-8cff-bd432120409d tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:47.928496 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-6478b208-17d4-4335-8cff-bd432120409d tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/43019934-5ced-4af9-81e5-d0373842bee0" status: 200 len: 1366 microversion: 2.1 time: 0.595761 Jun 22 10:30:47.930077 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 434/848] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:30:47 2022] GET /compute/v2.1/servers/43019934-5ced-4af9-81e5-d0373842bee0 => generated 1366 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:30:48.707640 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-fb942684-8773-48c8-b4b0-d5e3dc02e3ed tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:48.710608 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-fb942684-8773-48c8-b4b0-d5e3dc02e3ed tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:48.730605 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_cell0:SELECT=4 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:48.734333 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-fb942684-8773-48c8-b4b0-d5e3dc02e3ed tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:48.735774 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-fb942684-8773-48c8-b4b0-d5e3dc02e3ed tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:48.737585 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-fb942684-8773-48c8-b4b0-d5e3dc02e3ed tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:48.738798 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-fb942684-8773-48c8-b4b0-d5e3dc02e3ed tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:48.832203 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-f4fb85fd-740b-4f1b-be03-6cb152d514df req-7ac0eec9-b43c-4f96-a160-67fae8626de3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10d8ca63-dde5-47f0-a3d5-e0b2473d11ab", "tag": "a4a63615-2666-4669-8e9d-a427ca0e615a"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:30:48.857241 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-f4fb85fd-740b-4f1b-be03-6cb152d514df req-7ac0eec9-b43c-4f96-a160-67fae8626de3 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:48.858430 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-f4fb85fd-740b-4f1b-be03-6cb152d514df req-7ac0eec9-b43c-4f96-a160-67fae8626de3 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:48.889666 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-f4fb85fd-740b-4f1b-be03-6cb152d514df req-7ac0eec9-b43c-4f96-a160-67fae8626de3 service nova] Creating event network-changed:a4a63615-2666-4669-8e9d-a427ca0e615a for instance 10d8ca63-dde5-47f0-a3d5-e0b2473d11ab on hv-cinder-84713 Jun 22 10:30:48.899527 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-f4fb85fd-740b-4f1b-be03-6cb152d514df req-7ac0eec9-b43c-4f96-a160-67fae8626de3 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071434 Jun 22 10:30:48.901189 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 435/849] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:30:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:30:48.982901 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-d614fe1b-6268-4eb6-a6e1-b24cb9663a5f tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:48.992754 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-d614fe1b-6268-4eb6-a6e1-b24cb9663a5f tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: 43019934-5ced-4af9-81e5-d0373842bee0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:49.014881 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d614fe1b-6268-4eb6-a6e1-b24cb9663a5f tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:49.015697 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d614fe1b-6268-4eb6-a6e1-b24cb9663a5f tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:49.017545 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d614fe1b-6268-4eb6-a6e1-b24cb9663a5f tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:49.018326 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d614fe1b-6268-4eb6-a6e1-b24cb9663a5f tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:49.098134 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-fb942684-8773-48c8-b4b0-d5e3dc02e3ed tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:49.130410 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-fb942684-8773-48c8-b4b0-d5e3dc02e3ed tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:49.139958 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-fb942684-8773-48c8-b4b0-d5e3dc02e3ed tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:49.142110 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-fb942684-8773-48c8-b4b0-d5e3dc02e3ed tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1739 microversion: 2.20 time: 0.443903 Jun 22 10:30:49.153916 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 415/850] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:30:48 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1739 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:30:49.349597 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-d614fe1b-6268-4eb6-a6e1-b24cb9663a5f tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:49.365106 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-d614fe1b-6268-4eb6-a6e1-b24cb9663a5f tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/43019934-5ced-4af9-81e5-d0373842bee0" status: 200 len: 1366 microversion: 2.1 time: 0.404291 Jun 22 10:30:49.365869 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 436/851] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:30:48 2022] GET /compute/v2.1/servers/43019934-5ced-4af9-81e5-d0373842bee0 => generated 1366 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:30:50.187948 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-eea17572-6da7-48c8-8cf6-8de2e1396c72 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:50.192600 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-eea17572-6da7-48c8-8cf6-8de2e1396c72 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:50.208972 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-eea17572-6da7-48c8-8cf6-8de2e1396c72 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:50.209890 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-eea17572-6da7-48c8-8cf6-8de2e1396c72 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:50.213251 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-eea17572-6da7-48c8-8cf6-8de2e1396c72 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:50.216803 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-eea17572-6da7-48c8-8cf6-8de2e1396c72 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:50.399387 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-901b2ec5-2d8c-4700-b4d4-23b21dc240c5 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:50.400420 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-901b2ec5-2d8c-4700-b4d4-23b21dc240c5 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: 43019934-5ced-4af9-81e5-d0373842bee0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:50.443413 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-901b2ec5-2d8c-4700-b4d4-23b21dc240c5 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:50.444701 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-901b2ec5-2d8c-4700-b4d4-23b21dc240c5 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:50.450899 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-901b2ec5-2d8c-4700-b4d4-23b21dc240c5 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:50.452435 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-901b2ec5-2d8c-4700-b4d4-23b21dc240c5 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:50.467525 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-eea17572-6da7-48c8-8cf6-8de2e1396c72 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:50.495988 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-eea17572-6da7-48c8-8cf6-8de2e1396c72 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:50.500387 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-eea17572-6da7-48c8-8cf6-8de2e1396c72 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:50.504191 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-eea17572-6da7-48c8-8cf6-8de2e1396c72 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1739 microversion: 2.20 time: 0.327484 Jun 22 10:30:50.505501 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 416/852] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:30:50 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1739 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:30:50.602587 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell0:SELECT=2 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:50.864013 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell0:SELECT=8 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:50.895024 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-901b2ec5-2d8c-4700-b4d4-23b21dc240c5 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:50.942079 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-901b2ec5-2d8c-4700-b4d4-23b21dc240c5 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/43019934-5ced-4af9-81e5-d0373842bee0" status: 200 len: 1366 microversion: 2.1 time: 0.552456 Jun 22 10:30:50.943614 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 437/853] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:30:50 2022] GET /compute/v2.1/servers/43019934-5ced-4af9-81e5-d0373842bee0 => generated 1366 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:30:51.549215 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-8b45b297-154c-48f6-8f69-2dfccf86923c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:51.552209 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-8b45b297-154c-48f6-8f69-2dfccf86923c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:51.569655 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8b45b297-154c-48f6-8f69-2dfccf86923c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:51.570929 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8b45b297-154c-48f6-8f69-2dfccf86923c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:51.572267 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8b45b297-154c-48f6-8f69-2dfccf86923c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:51.573015 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8b45b297-154c-48f6-8f69-2dfccf86923c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:51.905300 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-8b45b297-154c-48f6-8f69-2dfccf86923c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:51.928517 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-8b45b297-154c-48f6-8f69-2dfccf86923c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:51.932287 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-8b45b297-154c-48f6-8f69-2dfccf86923c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:51.941619 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-8b45b297-154c-48f6-8f69-2dfccf86923c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1739 microversion: 2.20 time: 0.399508 Jun 22 10:30:51.944539 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 417/854] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:30:51 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1739 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:30:51.962381 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-247e2bd0-36ef-4b54-acd8-8b886070b19a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:51.964261 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-247e2bd0-36ef-4b54-acd8-8b886070b19a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: 43019934-5ced-4af9-81e5-d0373842bee0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:51.975347 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-247e2bd0-36ef-4b54-acd8-8b886070b19a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:51.976188 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-247e2bd0-36ef-4b54-acd8-8b886070b19a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:51.977182 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-247e2bd0-36ef-4b54-acd8-8b886070b19a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:51.977923 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-247e2bd0-36ef-4b54-acd8-8b886070b19a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:52.020114 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:SELECT=100 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:30:52.497246 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-247e2bd0-36ef-4b54-acd8-8b886070b19a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:52.508490 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-247e2bd0-36ef-4b54-acd8-8b886070b19a tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/43019934-5ced-4af9-81e5-d0373842bee0" status: 200 len: 1366 microversion: 2.1 time: 0.552429 Jun 22 10:30:52.509088 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 438/855] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:30:51 2022] GET /compute/v2.1/servers/43019934-5ced-4af9-81e5-d0373842bee0 => generated 1366 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:30:52.971222 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-f12e7148-eec0-4c82-8d2e-6692914c34d2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:52.972061 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-f12e7148-eec0-4c82-8d2e-6692914c34d2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:52.984836 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f12e7148-eec0-4c82-8d2e-6692914c34d2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:52.987706 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f12e7148-eec0-4c82-8d2e-6692914c34d2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:52.991426 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f12e7148-eec0-4c82-8d2e-6692914c34d2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:52.996297 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f12e7148-eec0-4c82-8d2e-6692914c34d2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:53.366854 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-f12e7148-eec0-4c82-8d2e-6692914c34d2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:53.389790 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-f12e7148-eec0-4c82-8d2e-6692914c34d2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:53.393834 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-f12e7148-eec0-4c82-8d2e-6692914c34d2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:53.395735 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-f12e7148-eec0-4c82-8d2e-6692914c34d2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1739 microversion: 2.20 time: 0.433136 Jun 22 10:30:53.427059 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 418/856] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:30:52 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1739 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:30:53.530582 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-2481f837-69c4-490e-bc42-b75739f0b2a7 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:53.531426 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-2481f837-69c4-490e-bc42-b75739f0b2a7 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: 43019934-5ced-4af9-81e5-d0373842bee0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:53.547816 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2481f837-69c4-490e-bc42-b75739f0b2a7 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:53.551434 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2481f837-69c4-490e-bc42-b75739f0b2a7 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:53.552615 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2481f837-69c4-490e-bc42-b75739f0b2a7 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:53.553069 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2481f837-69c4-490e-bc42-b75739f0b2a7 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:53.831143 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-2481f837-69c4-490e-bc42-b75739f0b2a7 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:53.843347 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-2481f837-69c4-490e-bc42-b75739f0b2a7 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/43019934-5ced-4af9-81e5-d0373842bee0" status: 200 len: 1366 microversion: 2.1 time: 0.321153 Jun 22 10:30:53.847449 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 439/857] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:30:53 2022] GET /compute/v2.1/servers/43019934-5ced-4af9-81e5-d0373842bee0 => generated 1366 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:30:54.439029 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-fa041dc9-f24b-4e18-94a5-b0657a5a2ee9 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:54.440568 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-fa041dc9-f24b-4e18-94a5-b0657a5a2ee9 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:54.451375 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-fa041dc9-f24b-4e18-94a5-b0657a5a2ee9 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:54.451836 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-fa041dc9-f24b-4e18-94a5-b0657a5a2ee9 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:54.452704 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-fa041dc9-f24b-4e18-94a5-b0657a5a2ee9 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:54.453230 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-fa041dc9-f24b-4e18-94a5-b0657a5a2ee9 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:54.717861 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-fa041dc9-f24b-4e18-94a5-b0657a5a2ee9 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:54.733740 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-fa041dc9-f24b-4e18-94a5-b0657a5a2ee9 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:54.738108 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-fa041dc9-f24b-4e18-94a5-b0657a5a2ee9 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:54.744300 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-fa041dc9-f24b-4e18-94a5-b0657a5a2ee9 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1739 microversion: 2.20 time: 0.312227 Jun 22 10:30:54.749172 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 419/858] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:30:54 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1739 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:30:54.869044 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-15daf6a5-fc28-47fd-a92a-2068d38e706e tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:54.870223 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-15daf6a5-fc28-47fd-a92a-2068d38e706e tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: 43019934-5ced-4af9-81e5-d0373842bee0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:54.892972 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-15daf6a5-fc28-47fd-a92a-2068d38e706e tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:54.893815 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-15daf6a5-fc28-47fd-a92a-2068d38e706e tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:54.899707 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-15daf6a5-fc28-47fd-a92a-2068d38e706e tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:54.922526 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-15daf6a5-fc28-47fd-a92a-2068d38e706e tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:55.044156 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-4054c8be-dcd6-4e51-a40d-543828c0a0bc req-5c7c4ca1-ac40-461d-a4dd-0bb560f6b7d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43019934-5ced-4af9-81e5-d0373842bee0", "name": "network-vif-plugged", "status": "completed", "tag": "0e25f1dd-b485-4c62-9076-a43bdc61b091"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:30:55.128415 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-4054c8be-dcd6-4e51-a40d-543828c0a0bc req-5c7c4ca1-ac40-461d-a4dd-0bb560f6b7d0 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:55.130939 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-4054c8be-dcd6-4e51-a40d-543828c0a0bc req-5c7c4ca1-ac40-461d-a4dd-0bb560f6b7d0 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:55.173956 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-4054c8be-dcd6-4e51-a40d-543828c0a0bc req-5c7c4ca1-ac40-461d-a4dd-0bb560f6b7d0 service nova] Creating event network-vif-plugged:0e25f1dd-b485-4c62-9076-a43bdc61b091 for instance 43019934-5ced-4af9-81e5-d0373842bee0 on hv-cinder-84713 Jun 22 10:30:55.193658 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-4054c8be-dcd6-4e51-a40d-543828c0a0bc req-5c7c4ca1-ac40-461d-a4dd-0bb560f6b7d0 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159275 Jun 22 10:30:55.194569 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 420/859] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:30:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:30:55.251421 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-15daf6a5-fc28-47fd-a92a-2068d38e706e tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:55.275208 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-15daf6a5-fc28-47fd-a92a-2068d38e706e tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/43019934-5ced-4af9-81e5-d0373842bee0" status: 200 len: 1366 microversion: 2.1 time: 0.413368 Jun 22 10:30:55.277490 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 440/860] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:30:54 2022] GET /compute/v2.1/servers/43019934-5ced-4af9-81e5-d0373842bee0 => generated 1366 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:30:55.781462 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-44209caa-1433-4013-b839-7d2cea724965 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:55.784501 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-44209caa-1433-4013-b839-7d2cea724965 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:55.798631 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-44209caa-1433-4013-b839-7d2cea724965 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:55.801142 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-44209caa-1433-4013-b839-7d2cea724965 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:55.802826 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-44209caa-1433-4013-b839-7d2cea724965 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:55.803760 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-44209caa-1433-4013-b839-7d2cea724965 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:56.008858 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-44209caa-1433-4013-b839-7d2cea724965 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:56.019198 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-44209caa-1433-4013-b839-7d2cea724965 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:56.020770 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-44209caa-1433-4013-b839-7d2cea724965 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:56.022020 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-44209caa-1433-4013-b839-7d2cea724965 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1739 microversion: 2.20 time: 0.250093 Jun 22 10:30:56.023097 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 421/861] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:30:55 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1739 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:30:56.300645 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-ac39f695-3b61-499d-8af9-0131aa1327e6 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:56.301449 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-ac39f695-3b61-499d-8af9-0131aa1327e6 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: 43019934-5ced-4af9-81e5-d0373842bee0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:56.308947 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ac39f695-3b61-499d-8af9-0131aa1327e6 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:56.309419 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ac39f695-3b61-499d-8af9-0131aa1327e6 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:56.310267 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ac39f695-3b61-499d-8af9-0131aa1327e6 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:56.310735 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ac39f695-3b61-499d-8af9-0131aa1327e6 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:56.499224 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-ac39f695-3b61-499d-8af9-0131aa1327e6 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:56.513664 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-ac39f695-3b61-499d-8af9-0131aa1327e6 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/43019934-5ced-4af9-81e5-d0373842bee0" status: 200 len: 1366 microversion: 2.1 time: 0.216736 Jun 22 10:30:56.514736 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 441/862] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:30:56 2022] GET /compute/v2.1/servers/43019934-5ced-4af9-81e5-d0373842bee0 => generated 1366 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:30:57.043787 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-4385a590-b646-441a-8fd5-88b75cfaa5bb tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:57.044485 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-4385a590-b646-441a-8fd5-88b75cfaa5bb tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:57.053665 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4385a590-b646-441a-8fd5-88b75cfaa5bb tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:57.054159 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4385a590-b646-441a-8fd5-88b75cfaa5bb tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:57.054988 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4385a590-b646-441a-8fd5-88b75cfaa5bb tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:57.055432 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4385a590-b646-441a-8fd5-88b75cfaa5bb tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:57.240654 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-4385a590-b646-441a-8fd5-88b75cfaa5bb tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:57.253387 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-4385a590-b646-441a-8fd5-88b75cfaa5bb tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:57.255457 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-4385a590-b646-441a-8fd5-88b75cfaa5bb tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:57.256834 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-4385a590-b646-441a-8fd5-88b75cfaa5bb tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1739 microversion: 2.20 time: 0.218361 Jun 22 10:30:57.257412 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 422/863] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:30:57 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1739 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:30:57.542747 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-accb47af-0fac-4529-bef1-00c456aeeac8 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:57.543851 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-accb47af-0fac-4529-bef1-00c456aeeac8 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: 43019934-5ced-4af9-81e5-d0373842bee0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:57.556246 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-accb47af-0fac-4529-bef1-00c456aeeac8 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:57.556816 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-accb47af-0fac-4529-bef1-00c456aeeac8 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:57.558033 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-accb47af-0fac-4529-bef1-00c456aeeac8 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:57.558822 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-accb47af-0fac-4529-bef1-00c456aeeac8 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:57.757969 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-accb47af-0fac-4529-bef1-00c456aeeac8 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:57.773231 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-accb47af-0fac-4529-bef1-00c456aeeac8 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/43019934-5ced-4af9-81e5-d0373842bee0" status: 200 len: 1556 microversion: 2.1 time: 0.237407 Jun 22 10:30:57.774491 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 442/864] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:30:57 2022] GET /compute/v2.1/servers/43019934-5ced-4af9-81e5-d0373842bee0 => generated 1556 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:30:57.793665 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-427f4653-48c2-4774-bdc9-ed2f306d0a1b tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:57.794458 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-427f4653-48c2-4774-bdc9-ed2f306d0a1b tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: 43019934-5ced-4af9-81e5-d0373842bee0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:57.805356 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-427f4653-48c2-4774-bdc9-ed2f306d0a1b tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:57.806218 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-427f4653-48c2-4774-bdc9-ed2f306d0a1b tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:57.807730 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-427f4653-48c2-4774-bdc9-ed2f306d0a1b tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:57.808556 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-427f4653-48c2-4774-bdc9-ed2f306d0a1b tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:57.929902 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-427f4653-48c2-4774-bdc9-ed2f306d0a1b tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/43019934-5ced-4af9-81e5-d0373842bee0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.141872 Jun 22 10:30:57.930983 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 423/865] 10.222.0.66 () {58 vars in 1274 bytes} [Wed Jun 22 10:30:57 2022] GET /compute/v2.1/servers/43019934-5ced-4af9-81e5-d0373842bee0/os-interface => generated 284 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:30:58.280597 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-f9673d4a-3258-48e0-875e-998d9ab8f6ac tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:58.288134 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-f9673d4a-3258-48e0-875e-998d9ab8f6ac tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:58.302646 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f9673d4a-3258-48e0-875e-998d9ab8f6ac tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:58.303743 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f9673d4a-3258-48e0-875e-998d9ab8f6ac tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:58.305493 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f9673d4a-3258-48e0-875e-998d9ab8f6ac tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:58.306575 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f9673d4a-3258-48e0-875e-998d9ab8f6ac tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:58.562144 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-f9673d4a-3258-48e0-875e-998d9ab8f6ac tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:58.574263 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-f9673d4a-3258-48e0-875e-998d9ab8f6ac tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:58.575813 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-f9673d4a-3258-48e0-875e-998d9ab8f6ac tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:30:58.580152 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-f9673d4a-3258-48e0-875e-998d9ab8f6ac tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1721 microversion: 2.20 time: 0.305629 Jun 22 10:30:58.583595 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 443/866] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:30:58 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1721 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:30:59.365988 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-69bc9a69-d551-431b-b12d-d22989ef6d9f req-2e09d055-7a6f-4ad0-974d-db50b48fea65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43019934-5ced-4af9-81e5-d0373842bee0", "tag": "0e25f1dd-b485-4c62-9076-a43bdc61b091"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:30:59.380769 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-69bc9a69-d551-431b-b12d-d22989ef6d9f req-2e09d055-7a6f-4ad0-974d-db50b48fea65 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:59.381553 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-69bc9a69-d551-431b-b12d-d22989ef6d9f req-2e09d055-7a6f-4ad0-974d-db50b48fea65 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:59.404688 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-69bc9a69-d551-431b-b12d-d22989ef6d9f req-2e09d055-7a6f-4ad0-974d-db50b48fea65 service nova] Creating event network-changed:0e25f1dd-b485-4c62-9076-a43bdc61b091 for instance 43019934-5ced-4af9-81e5-d0373842bee0 on hv-cinder-84713 Jun 22 10:30:59.413397 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-69bc9a69-d551-431b-b12d-d22989ef6d9f req-2e09d055-7a6f-4ad0-974d-db50b48fea65 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057087 Jun 22 10:30:59.415257 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 424/867] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:30:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:30:59.609417 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-a1786e0c-ca90-49e4-93e4-d25521a5b0af tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:30:59.610872 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-a1786e0c-ca90-49e4-93e4-d25521a5b0af tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:30:59.619540 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a1786e0c-ca90-49e4-93e4-d25521a5b0af tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:59.620224 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a1786e0c-ca90-49e4-93e4-d25521a5b0af tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:30:59.621366 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a1786e0c-ca90-49e4-93e4-d25521a5b0af tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:30:59.621956 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a1786e0c-ca90-49e4-93e4-d25521a5b0af tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:00.075602 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-a1786e0c-ca90-49e4-93e4-d25521a5b0af tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:00.086749 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-a1786e0c-ca90-49e4-93e4-d25521a5b0af tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:00.089001 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-a1786e0c-ca90-49e4-93e4-d25521a5b0af tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:00.090289 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-a1786e0c-ca90-49e4-93e4-d25521a5b0af tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1721 microversion: 2.20 time: 0.485458 Jun 22 10:31:00.091129 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 444/868] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:30:59 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1721 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:31:01.112278 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-a7c2edc5-36f9-4d53-a67d-25c6edc246db tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:01.113396 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-a7c2edc5-36f9-4d53-a67d-25c6edc246db tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:01.122427 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a7c2edc5-36f9-4d53-a67d-25c6edc246db tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:01.123155 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a7c2edc5-36f9-4d53-a67d-25c6edc246db tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:01.124462 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a7c2edc5-36f9-4d53-a67d-25c6edc246db tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:01.125333 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a7c2edc5-36f9-4d53-a67d-25c6edc246db tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:01.295930 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-a7c2edc5-36f9-4d53-a67d-25c6edc246db tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:01.305036 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-a7c2edc5-36f9-4d53-a67d-25c6edc246db tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:01.306592 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-a7c2edc5-36f9-4d53-a67d-25c6edc246db tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:01.307883 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-a7c2edc5-36f9-4d53-a67d-25c6edc246db tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1724 microversion: 2.20 time: 0.202460 Jun 22 10:31:01.308974 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 425/869] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:31:01 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1724 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:31:01.347206 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-0700c9f4-d5f2-4425-b4b8-b8ae9bd73545 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "de9bd342-629f-478b-a794-03f6a038ae6a"}} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:31:01.351525 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-0700c9f4-d5f2-4425-b4b8-b8ae9bd73545 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:01.369255 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0700c9f4-d5f2-4425-b4b8-b8ae9bd73545 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:01.370033 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0700c9f4-d5f2-4425-b4b8-b8ae9bd73545 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:01.374203 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0700c9f4-d5f2-4425-b4b8-b8ae9bd73545 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:01.377966 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0700c9f4-d5f2-4425-b4b8-b8ae9bd73545 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:01.858251 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-0700c9f4-d5f2-4425-b4b8-b8ae9bd73545 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "POST /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.521565 Jun 22 10:31:01.862565 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 445/870] 10.222.0.66 () {62 vars in 1363 bytes} [Wed Jun 22 10:31:01 2022] POST /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0/os-volume_attachments => generated 188 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 22 10:31:02.035775 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-35ae50eb-3916-489a-be07-322c4e58a987 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:02.036716 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-35ae50eb-3916-489a-be07-322c4e58a987 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:02.047211 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-35ae50eb-3916-489a-be07-322c4e58a987 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:02.047675 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-35ae50eb-3916-489a-be07-322c4e58a987 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:02.048481 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-35ae50eb-3916-489a-be07-322c4e58a987 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:02.048941 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-35ae50eb-3916-489a-be07-322c4e58a987 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:02.392306 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-f8290173-b7f5-49c3-8bcd-f574dbd183f0 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:02.392899 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-f8290173-b7f5-49c3-8bcd-f574dbd183f0 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: a1520a14-618c-4e2d-b20d-a08ebd9f6daa] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:02.404080 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f8290173-b7f5-49c3-8bcd-f574dbd183f0 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:02.404855 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f8290173-b7f5-49c3-8bcd-f574dbd183f0 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:02.405665 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f8290173-b7f5-49c3-8bcd-f574dbd183f0 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:02.406113 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f8290173-b7f5-49c3-8bcd-f574dbd183f0 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:02.414606 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-35ae50eb-3916-489a-be07-322c4e58a987 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "DELETE /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0/os-volume_attachments/de9bd342-629f-478b-a794-03f6a038ae6a" status: 202 len: 0 microversion: 2.20 time: 0.385469 Jun 22 10:31:02.415994 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 426/871] 10.222.0.66 () {60 vars in 1456 bytes} [Wed Jun 22 10:31:02 2022] DELETE /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0/os-volume_attachments/de9bd342-629f-478b-a794-03f6a038ae6a => generated 0 bytes in 389 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 22 10:31:02.440645 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-f8290173-b7f5-49c3-8bcd-f574dbd183f0 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa/ips" status: 200 len: 143 microversion: 2.1 time: 0.052274 Jun 22 10:31:02.441283 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 446/872] 10.222.0.66 () {58 vars in 1247 bytes} [Wed Jun 22 10:31:02 2022] GET /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa/ips => generated 143 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:31:02.514948 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-bba498e3-214f-44aa-8009-29bcf3075bfb tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:31:02.516326 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-bba498e3-214f-44aa-8009-29bcf3075bfb tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:02.528111 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-bba498e3-214f-44aa-8009-29bcf3075bfb tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:02.528839 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-bba498e3-214f-44aa-8009-29bcf3075bfb tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:02.530172 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-bba498e3-214f-44aa-8009-29bcf3075bfb tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:02.530945 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-bba498e3-214f-44aa-8009-29bcf3075bfb tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:02.538410 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:31:02.658861 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-bba498e3-214f-44aa-8009-29bcf3075bfb tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "POST /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0/action" status: 202 len: 0 microversion: 2.20 time: 0.149997 Jun 22 10:31:02.660605 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 427/873] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Jun 22 10:31:02 2022] POST /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 22 10:31:02.675332 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-59d2d3c8-3e71-4bde-b913-65d20c95739c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:02.676928 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-59d2d3c8-3e71-4bde-b913-65d20c95739c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:02.705099 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-59d2d3c8-3e71-4bde-b913-65d20c95739c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:02.715556 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-59d2d3c8-3e71-4bde-b913-65d20c95739c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:02.717308 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-59d2d3c8-3e71-4bde-b913-65d20c95739c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:02.718858 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-59d2d3c8-3e71-4bde-b913-65d20c95739c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:03.011594 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-59d2d3c8-3e71-4bde-b913-65d20c95739c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:03.029997 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-2ff21a85-6f19-4d07-ba3c-dd08f0e5bb34 req-c47f3c5a-60c8-4303-b23f-4bd137d9a254 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d288ac1d-ffb9-4ac1-a5a4-095bf673cea0", "name": "network-vif-unplugged", "status": "completed", "tag": "41f6ee40-8d5d-4ffb-b909-afe6a1d8f347"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:31:03.033319 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-59d2d3c8-3e71-4bde-b913-65d20c95739c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:03.037313 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-59d2d3c8-3e71-4bde-b913-65d20c95739c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:03.040387 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-59d2d3c8-3e71-4bde-b913-65d20c95739c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1672 microversion: 2.20 time: 0.373639 Jun 22 10:31:03.042558 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 447/874] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:31:02 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1672 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:31:03.050374 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-2ff21a85-6f19-4d07-ba3c-dd08f0e5bb34 req-c47f3c5a-60c8-4303-b23f-4bd137d9a254 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:03.052422 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-2ff21a85-6f19-4d07-ba3c-dd08f0e5bb34 req-c47f3c5a-60c8-4303-b23f-4bd137d9a254 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:03.077079 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.compute.server_external_events [req-2ff21a85-6f19-4d07-ba3c-dd08f0e5bb34 req-c47f3c5a-60c8-4303-b23f-4bd137d9a254 service nova] Unable to find a host for instance d288ac1d-ffb9-4ac1-a5a4-095bf673cea0. Dropping event network-vif-unplugged {{(pid=117679) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 22 10:31:03.078804 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-2ff21a85-6f19-4d07-ba3c-dd08f0e5bb34 req-c47f3c5a-60c8-4303-b23f-4bd137d9a254 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.058628 Jun 22 10:31:03.079829 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 428/875] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:31:03 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 61 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 22 10:31:04.087160 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-2489abf3-43cb-4eae-ae0c-266385d12919 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f5db5b49-6662-45e5-a150-29c6b465175f"}} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:31:04.090755 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-9d732c6e-5470-499b-a867-498602195df8 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:04.091549 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-2489abf3-43cb-4eae-ae0c-266385d12919 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: a1520a14-618c-4e2d-b20d-a08ebd9f6daa] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:04.092288 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-9d732c6e-5470-499b-a867-498602195df8 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:04.104109 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2489abf3-43cb-4eae-ae0c-266385d12919 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:04.105396 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2489abf3-43cb-4eae-ae0c-266385d12919 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:04.107752 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2489abf3-43cb-4eae-ae0c-266385d12919 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:04.108850 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2489abf3-43cb-4eae-ae0c-266385d12919 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:04.109165 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9d732c6e-5470-499b-a867-498602195df8 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:04.109978 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9d732c6e-5470-499b-a867-498602195df8 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:04.111615 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9d732c6e-5470-499b-a867-498602195df8 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:04.112265 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9d732c6e-5470-499b-a867-498602195df8 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:04.338699 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-9d732c6e-5470-499b-a867-498602195df8 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:04.356875 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-9d732c6e-5470-499b-a867-498602195df8 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:04.359857 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-9d732c6e-5470-499b-a867-498602195df8 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:04.361711 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-9d732c6e-5470-499b-a867-498602195df8 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1672 microversion: 2.20 time: 0.294868 Jun 22 10:31:04.362990 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 448/876] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:31:04 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1672 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:31:04.505342 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-2489abf3-43cb-4eae-ae0c-266385d12919 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "POST /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.430607 Jun 22 10:31:04.506076 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 429/877] 10.222.0.66 () {60 vars in 1322 bytes} [Wed Jun 22 10:31:04 2022] POST /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa/os-volume_attachments => generated 194 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:31:05.388092 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-8dd20fa5-108e-47d5-9a92-97767b042cc8 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:05.389385 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-8dd20fa5-108e-47d5-9a92-97767b042cc8 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:05.398087 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8dd20fa5-108e-47d5-9a92-97767b042cc8 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:05.398628 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8dd20fa5-108e-47d5-9a92-97767b042cc8 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:05.399735 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8dd20fa5-108e-47d5-9a92-97767b042cc8 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:05.400591 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8dd20fa5-108e-47d5-9a92-97767b042cc8 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:05.619859 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-8dd20fa5-108e-47d5-9a92-97767b042cc8 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:05.635269 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-8dd20fa5-108e-47d5-9a92-97767b042cc8 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:05.640012 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-8dd20fa5-108e-47d5-9a92-97767b042cc8 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:05.642566 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-8dd20fa5-108e-47d5-9a92-97767b042cc8 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1730 microversion: 2.20 time: 0.261765 Jun 22 10:31:05.652973 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 449/878] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:31:05 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1730 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:31:06.670439 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-2cd55ad7-fbfa-458f-839e-2fe0514a721c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:06.671868 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-2cd55ad7-fbfa-458f-839e-2fe0514a721c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:06.681622 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2cd55ad7-fbfa-458f-839e-2fe0514a721c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:06.682069 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2cd55ad7-fbfa-458f-839e-2fe0514a721c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:06.682920 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2cd55ad7-fbfa-458f-839e-2fe0514a721c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:06.683864 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2cd55ad7-fbfa-458f-839e-2fe0514a721c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:06.876225 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-2cd55ad7-fbfa-458f-839e-2fe0514a721c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:06.885819 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-2cd55ad7-fbfa-458f-839e-2fe0514a721c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:06.887643 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-2cd55ad7-fbfa-458f-839e-2fe0514a721c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:06.889062 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-2cd55ad7-fbfa-458f-839e-2fe0514a721c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1730 microversion: 2.20 time: 0.227340 Jun 22 10:31:06.889736 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 430/879] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:31:06 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1730 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:31:07.915480 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-273ec94e-aaba-4b5a-9c3a-56e62829bb7c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:07.916100 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-273ec94e-aaba-4b5a-9c3a-56e62829bb7c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:07.924022 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-273ec94e-aaba-4b5a-9c3a-56e62829bb7c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:07.924516 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-273ec94e-aaba-4b5a-9c3a-56e62829bb7c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:07.925342 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-273ec94e-aaba-4b5a-9c3a-56e62829bb7c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:07.925814 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-273ec94e-aaba-4b5a-9c3a-56e62829bb7c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:08.102183 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-273ec94e-aaba-4b5a-9c3a-56e62829bb7c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:08.114278 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-273ec94e-aaba-4b5a-9c3a-56e62829bb7c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:08.116200 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-273ec94e-aaba-4b5a-9c3a-56e62829bb7c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:08.117620 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-273ec94e-aaba-4b5a-9c3a-56e62829bb7c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1730 microversion: 2.20 time: 0.207068 Jun 22 10:31:08.118362 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 450/880] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:31:07 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1730 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:31:09.137707 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-bfd28088-c65d-4cd2-8020-461f0f5a1f5e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:09.138534 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-bfd28088-c65d-4cd2-8020-461f0f5a1f5e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:09.151084 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-bfd28088-c65d-4cd2-8020-461f0f5a1f5e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:09.151865 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-bfd28088-c65d-4cd2-8020-461f0f5a1f5e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:09.153586 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-bfd28088-c65d-4cd2-8020-461f0f5a1f5e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:09.154352 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-bfd28088-c65d-4cd2-8020-461f0f5a1f5e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:09.365239 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-bfd28088-c65d-4cd2-8020-461f0f5a1f5e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:09.376024 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-bfd28088-c65d-4cd2-8020-461f0f5a1f5e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:09.378146 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-bfd28088-c65d-4cd2-8020-461f0f5a1f5e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:09.380179 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-bfd28088-c65d-4cd2-8020-461f0f5a1f5e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1730 microversion: 2.20 time: 0.247478 Jun 22 10:31:09.381150 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 431/881] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:31:09 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1730 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:31:10.404789 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-5c9d7295-b1a0-4b1f-803d-da5400dcf62f tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:10.405981 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-5c9d7295-b1a0-4b1f-803d-da5400dcf62f tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:10.410062 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:31:10.419184 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5c9d7295-b1a0-4b1f-803d-da5400dcf62f tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:10.419769 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5c9d7295-b1a0-4b1f-803d-da5400dcf62f tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:10.420616 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5c9d7295-b1a0-4b1f-803d-da5400dcf62f tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:10.421098 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5c9d7295-b1a0-4b1f-803d-da5400dcf62f tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:10.601487 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-5c9d7295-b1a0-4b1f-803d-da5400dcf62f tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:10.612103 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-5c9d7295-b1a0-4b1f-803d-da5400dcf62f tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:10.613853 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-5c9d7295-b1a0-4b1f-803d-da5400dcf62f tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:10.615271 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-5c9d7295-b1a0-4b1f-803d-da5400dcf62f tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1730 microversion: 2.20 time: 0.218109 Jun 22 10:31:10.616002 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 451/882] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:31:10 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1730 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:31:11.640926 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-558dbb5f-5935-41c6-801f-fa4b749a90ab tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:11.641672 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-558dbb5f-5935-41c6-801f-fa4b749a90ab tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:11.645214 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_api:SELECT=56 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:31:11.650466 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-558dbb5f-5935-41c6-801f-fa4b749a90ab tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:11.650962 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-558dbb5f-5935-41c6-801f-fa4b749a90ab tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:11.651775 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-558dbb5f-5935-41c6-801f-fa4b749a90ab tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:11.652604 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-558dbb5f-5935-41c6-801f-fa4b749a90ab tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:11.811220 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-558dbb5f-5935-41c6-801f-fa4b749a90ab tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:11.820362 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-558dbb5f-5935-41c6-801f-fa4b749a90ab tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:11.821949 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-558dbb5f-5935-41c6-801f-fa4b749a90ab tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:11.823229 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-558dbb5f-5935-41c6-801f-fa4b749a90ab tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1730 microversion: 2.20 time: 0.186663 Jun 22 10:31:11.823828 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 432/883] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:31:11 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1730 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:31:12.848599 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-16537fb0-fd76-4bef-b6a1-c999d2a2abaf tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:12.849306 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-16537fb0-fd76-4bef-b6a1-c999d2a2abaf tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:12.856413 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-16537fb0-fd76-4bef-b6a1-c999d2a2abaf tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:12.856965 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-16537fb0-fd76-4bef-b6a1-c999d2a2abaf tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:12.858064 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-16537fb0-fd76-4bef-b6a1-c999d2a2abaf tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:12.858651 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-16537fb0-fd76-4bef-b6a1-c999d2a2abaf tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:12.880626 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:31:13.033371 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-16537fb0-fd76-4bef-b6a1-c999d2a2abaf tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:13.042611 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-16537fb0-fd76-4bef-b6a1-c999d2a2abaf tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:13.044285 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-16537fb0-fd76-4bef-b6a1-c999d2a2abaf tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:13.045559 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-16537fb0-fd76-4bef-b6a1-c999d2a2abaf tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1730 microversion: 2.20 time: 0.200993 Jun 22 10:31:13.046552 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 452/884] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:31:12 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1730 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:31:14.066724 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-54549114-d551-4172-a826-e746b3150eb0 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:14.067850 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-54549114-d551-4172-a826-e746b3150eb0 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:14.077175 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-54549114-d551-4172-a826-e746b3150eb0 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:14.077823 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-54549114-d551-4172-a826-e746b3150eb0 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:14.079601 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-54549114-d551-4172-a826-e746b3150eb0 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:14.080316 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-54549114-d551-4172-a826-e746b3150eb0 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:14.257392 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-54549114-d551-4172-a826-e746b3150eb0 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:14.273203 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-54549114-d551-4172-a826-e746b3150eb0 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:14.277014 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-54549114-d551-4172-a826-e746b3150eb0 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:14.279553 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-54549114-d551-4172-a826-e746b3150eb0 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1730 microversion: 2.20 time: 0.217451 Jun 22 10:31:14.305737 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 433/885] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:31:14 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1730 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:31:15.316890 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-dc6afddc-8ef1-42e5-b304-804ac9d40e6b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:15.317980 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-dc6afddc-8ef1-42e5-b304-804ac9d40e6b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:15.326853 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-dc6afddc-8ef1-42e5-b304-804ac9d40e6b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:15.327316 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-dc6afddc-8ef1-42e5-b304-804ac9d40e6b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:15.328140 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-dc6afddc-8ef1-42e5-b304-804ac9d40e6b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:15.328559 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-dc6afddc-8ef1-42e5-b304-804ac9d40e6b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:15.490614 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-dc6afddc-8ef1-42e5-b304-804ac9d40e6b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:15.505973 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-dc6afddc-8ef1-42e5-b304-804ac9d40e6b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:15.509259 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-dc6afddc-8ef1-42e5-b304-804ac9d40e6b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:15.511496 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-dc6afddc-8ef1-42e5-b304-804ac9d40e6b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1730 microversion: 2.20 time: 0.204528 Jun 22 10:31:15.512510 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 453/886] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:31:15 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1730 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:31:16.535175 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-215d6f0d-c8c7-4f40-92d0-68574d77bece tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:16.536185 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-215d6f0d-c8c7-4f40-92d0-68574d77bece tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:16.545249 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-215d6f0d-c8c7-4f40-92d0-68574d77bece tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:16.546050 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-215d6f0d-c8c7-4f40-92d0-68574d77bece tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:16.547571 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-215d6f0d-c8c7-4f40-92d0-68574d77bece tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:16.548374 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-215d6f0d-c8c7-4f40-92d0-68574d77bece tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:16.743366 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-215d6f0d-c8c7-4f40-92d0-68574d77bece tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:16.760822 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-215d6f0d-c8c7-4f40-92d0-68574d77bece tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:16.764342 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-215d6f0d-c8c7-4f40-92d0-68574d77bece tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:16.766738 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-215d6f0d-c8c7-4f40-92d0-68574d77bece tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1730 microversion: 2.20 time: 0.236862 Jun 22 10:31:16.768165 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 434/887] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:31:16 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1730 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:31:17.786339 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-f9656679-0e83-434b-a497-c144e462e3e2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:17.787158 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-f9656679-0e83-434b-a497-c144e462e3e2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:17.793881 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f9656679-0e83-434b-a497-c144e462e3e2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:17.794337 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f9656679-0e83-434b-a497-c144e462e3e2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:17.795185 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f9656679-0e83-434b-a497-c144e462e3e2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:17.795626 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f9656679-0e83-434b-a497-c144e462e3e2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:17.979553 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-f9656679-0e83-434b-a497-c144e462e3e2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:17.996751 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-f9656679-0e83-434b-a497-c144e462e3e2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:18.000426 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-f9656679-0e83-434b-a497-c144e462e3e2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:18.002910 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-f9656679-0e83-434b-a497-c144e462e3e2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1730 microversion: 2.20 time: 0.220895 Jun 22 10:31:18.003608 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 454/888] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:31:17 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1730 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:31:19.031269 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-2fad2d8c-8f3d-4608-ba6a-b031b2940ad9 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:19.032231 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-2fad2d8c-8f3d-4608-ba6a-b031b2940ad9 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:19.039173 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2fad2d8c-8f3d-4608-ba6a-b031b2940ad9 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:19.039724 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2fad2d8c-8f3d-4608-ba6a-b031b2940ad9 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:19.040623 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2fad2d8c-8f3d-4608-ba6a-b031b2940ad9 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:19.041137 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2fad2d8c-8f3d-4608-ba6a-b031b2940ad9 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:19.187622 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-2fad2d8c-8f3d-4608-ba6a-b031b2940ad9 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:19.198052 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-2fad2d8c-8f3d-4608-ba6a-b031b2940ad9 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:19.199578 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-2fad2d8c-8f3d-4608-ba6a-b031b2940ad9 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:19.200780 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-2fad2d8c-8f3d-4608-ba6a-b031b2940ad9 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1730 microversion: 2.20 time: 0.174222 Jun 22 10:31:19.201493 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 435/889] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:31:19 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:31:20.224553 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-82d0367e-5f02-45f3-bfeb-44f7f14d01ce tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:20.225649 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-82d0367e-5f02-45f3-bfeb-44f7f14d01ce tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:20.236941 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-82d0367e-5f02-45f3-bfeb-44f7f14d01ce tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:20.237726 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-82d0367e-5f02-45f3-bfeb-44f7f14d01ce tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:20.239149 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-82d0367e-5f02-45f3-bfeb-44f7f14d01ce tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:20.239915 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-82d0367e-5f02-45f3-bfeb-44f7f14d01ce tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:20.411945 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-82d0367e-5f02-45f3-bfeb-44f7f14d01ce tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:20.420771 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-82d0367e-5f02-45f3-bfeb-44f7f14d01ce tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:20.422595 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-82d0367e-5f02-45f3-bfeb-44f7f14d01ce tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:20.423796 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-82d0367e-5f02-45f3-bfeb-44f7f14d01ce tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1730 microversion: 2.20 time: 0.206653 Jun 22 10:31:20.424373 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 455/890] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:31:20 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1730 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:31:21.441864 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-a5f17d90-b88c-4c27-a955-e3794889d6fc tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:21.442493 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-a5f17d90-b88c-4c27-a955-e3794889d6fc tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:21.449825 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a5f17d90-b88c-4c27-a955-e3794889d6fc tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:21.450290 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a5f17d90-b88c-4c27-a955-e3794889d6fc tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:21.451131 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a5f17d90-b88c-4c27-a955-e3794889d6fc tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:21.451583 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a5f17d90-b88c-4c27-a955-e3794889d6fc tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:21.603494 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-a5f17d90-b88c-4c27-a955-e3794889d6fc tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:21.612274 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-a5f17d90-b88c-4c27-a955-e3794889d6fc tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:21.613783 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-a5f17d90-b88c-4c27-a955-e3794889d6fc tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:21.615012 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-a5f17d90-b88c-4c27-a955-e3794889d6fc tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1730 microversion: 2.20 time: 0.177442 Jun 22 10:31:21.615592 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 436/891] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:31:21 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1730 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:31:22.637675 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-e1a38bc2-78de-4b32-b0ac-1669b50df693 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:22.639876 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-e1a38bc2-78de-4b32-b0ac-1669b50df693 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:22.652665 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e1a38bc2-78de-4b32-b0ac-1669b50df693 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:22.653616 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e1a38bc2-78de-4b32-b0ac-1669b50df693 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:22.655179 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e1a38bc2-78de-4b32-b0ac-1669b50df693 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:22.655946 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e1a38bc2-78de-4b32-b0ac-1669b50df693 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:22.804814 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-e1a38bc2-78de-4b32-b0ac-1669b50df693 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:22.813646 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-e1a38bc2-78de-4b32-b0ac-1669b50df693 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:22.815182 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-e1a38bc2-78de-4b32-b0ac-1669b50df693 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:22.816386 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-e1a38bc2-78de-4b32-b0ac-1669b50df693 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1730 microversion: 2.20 time: 0.186145 Jun 22 10:31:22.817328 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 456/892] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:31:22 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1730 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:31:23.843513 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-5e26c06d-f62e-4547-b9b4-cf799fd79e62 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:23.844112 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-5e26c06d-f62e-4547-b9b4-cf799fd79e62 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:23.851424 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5e26c06d-f62e-4547-b9b4-cf799fd79e62 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:23.851875 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5e26c06d-f62e-4547-b9b4-cf799fd79e62 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:23.852673 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5e26c06d-f62e-4547-b9b4-cf799fd79e62 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:23.853113 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5e26c06d-f62e-4547-b9b4-cf799fd79e62 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:24.045595 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-5e26c06d-f62e-4547-b9b4-cf799fd79e62 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:24.054702 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-5e26c06d-f62e-4547-b9b4-cf799fd79e62 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:24.056295 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-5e26c06d-f62e-4547-b9b4-cf799fd79e62 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:24.057637 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-5e26c06d-f62e-4547-b9b4-cf799fd79e62 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1730 microversion: 2.20 time: 0.218138 Jun 22 10:31:24.058223 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 437/893] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:31:23 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1730 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:31:25.078004 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-7602c60f-d295-4ef9-99e7-b806828a3fa0 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:25.078714 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-7602c60f-d295-4ef9-99e7-b806828a3fa0 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:25.086873 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7602c60f-d295-4ef9-99e7-b806828a3fa0 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:25.087626 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7602c60f-d295-4ef9-99e7-b806828a3fa0 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:25.088752 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7602c60f-d295-4ef9-99e7-b806828a3fa0 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:25.089302 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7602c60f-d295-4ef9-99e7-b806828a3fa0 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:25.246170 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-7602c60f-d295-4ef9-99e7-b806828a3fa0 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:25.261651 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-7602c60f-d295-4ef9-99e7-b806828a3fa0 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:25.264688 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-7602c60f-d295-4ef9-99e7-b806828a3fa0 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:25.266976 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-7602c60f-d295-4ef9-99e7-b806828a3fa0 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1730 microversion: 2.20 time: 0.192960 Jun 22 10:31:25.267983 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 457/894] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:31:25 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1730 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:31:26.287599 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-33fdf21e-9ede-4af8-b85b-6af2a1dbf754 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:26.288290 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-33fdf21e-9ede-4af8-b85b-6af2a1dbf754 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:26.295755 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-33fdf21e-9ede-4af8-b85b-6af2a1dbf754 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:26.296206 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-33fdf21e-9ede-4af8-b85b-6af2a1dbf754 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:26.297212 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-33fdf21e-9ede-4af8-b85b-6af2a1dbf754 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:26.297657 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-33fdf21e-9ede-4af8-b85b-6af2a1dbf754 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:26.447784 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-33fdf21e-9ede-4af8-b85b-6af2a1dbf754 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:26.456499 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-33fdf21e-9ede-4af8-b85b-6af2a1dbf754 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:26.458006 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-33fdf21e-9ede-4af8-b85b-6af2a1dbf754 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:26.459218 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-33fdf21e-9ede-4af8-b85b-6af2a1dbf754 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1730 microversion: 2.20 time: 0.176363 Jun 22 10:31:26.459783 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 438/895] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:31:26 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:31:27.481268 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-94c50a4a-4694-493d-b116-d381c74ca4da tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:27.482290 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-94c50a4a-4694-493d-b116-d381c74ca4da tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:27.493886 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-94c50a4a-4694-493d-b116-d381c74ca4da tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:27.494655 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-94c50a4a-4694-493d-b116-d381c74ca4da tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:27.496028 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-94c50a4a-4694-493d-b116-d381c74ca4da tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:27.496786 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-94c50a4a-4694-493d-b116-d381c74ca4da tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:27.673933 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-94c50a4a-4694-493d-b116-d381c74ca4da tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:27.683858 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-94c50a4a-4694-493d-b116-d381c74ca4da tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:27.685427 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-94c50a4a-4694-493d-b116-d381c74ca4da tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:27.686686 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-94c50a4a-4694-493d-b116-d381c74ca4da tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1730 microversion: 2.20 time: 0.211866 Jun 22 10:31:27.687302 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 458/896] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:31:27 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1730 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:31:28.707018 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-ee2d1b91-f2b5-409b-8c61-4c16e27cb3c4 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:28.707684 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-ee2d1b91-f2b5-409b-8c61-4c16e27cb3c4 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:28.715277 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ee2d1b91-f2b5-409b-8c61-4c16e27cb3c4 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:28.715769 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ee2d1b91-f2b5-409b-8c61-4c16e27cb3c4 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:28.716738 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ee2d1b91-f2b5-409b-8c61-4c16e27cb3c4 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:28.717225 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-ee2d1b91-f2b5-409b-8c61-4c16e27cb3c4 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:28.871012 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-ee2d1b91-f2b5-409b-8c61-4c16e27cb3c4 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:28.880092 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-ee2d1b91-f2b5-409b-8c61-4c16e27cb3c4 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:28.881615 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-ee2d1b91-f2b5-409b-8c61-4c16e27cb3c4 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:28.882895 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-ee2d1b91-f2b5-409b-8c61-4c16e27cb3c4 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1730 microversion: 2.20 time: 0.180667 Jun 22 10:31:28.883474 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 439/897] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:31:28 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1730 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:31:29.902045 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-fb86cbf1-b53f-46d7-b074-b0b22af0988b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:29.903154 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-fb86cbf1-b53f-46d7-b074-b0b22af0988b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:29.910692 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fb86cbf1-b53f-46d7-b074-b0b22af0988b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:29.911156 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fb86cbf1-b53f-46d7-b074-b0b22af0988b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:29.911962 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fb86cbf1-b53f-46d7-b074-b0b22af0988b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:29.912401 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-fb86cbf1-b53f-46d7-b074-b0b22af0988b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:30.065999 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-fb86cbf1-b53f-46d7-b074-b0b22af0988b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:30.075020 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-fb86cbf1-b53f-46d7-b074-b0b22af0988b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:30.076597 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-fb86cbf1-b53f-46d7-b074-b0b22af0988b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:30.078159 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-fb86cbf1-b53f-46d7-b074-b0b22af0988b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1730 microversion: 2.20 time: 0.180571 Jun 22 10:31:30.078825 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 459/898] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:31:29 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1730 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:31:31.098263 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-0fd8bc28-3b0b-4cf8-8b46-546469a37463 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:31.099157 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-0fd8bc28-3b0b-4cf8-8b46-546469a37463 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:31.107068 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0fd8bc28-3b0b-4cf8-8b46-546469a37463 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:31.107569 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0fd8bc28-3b0b-4cf8-8b46-546469a37463 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:31.108437 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0fd8bc28-3b0b-4cf8-8b46-546469a37463 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:31.109029 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0fd8bc28-3b0b-4cf8-8b46-546469a37463 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:31.264299 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-0fd8bc28-3b0b-4cf8-8b46-546469a37463 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:31.273269 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-0fd8bc28-3b0b-4cf8-8b46-546469a37463 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:31.274903 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-0fd8bc28-3b0b-4cf8-8b46-546469a37463 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:31.276685 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-0fd8bc28-3b0b-4cf8-8b46-546469a37463 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1730 microversion: 2.20 time: 0.183815 Jun 22 10:31:31.277807 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 440/899] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:31:31 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1730 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:31:31.429895 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-afe22de3-9e19-43d0-bb0d-f2a705a23819 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:31.431365 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-afe22de3-9e19-43d0-bb0d-f2a705a23819 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: a1520a14-618c-4e2d-b20d-a08ebd9f6daa] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:31.438946 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-afe22de3-9e19-43d0-bb0d-f2a705a23819 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:31.439530 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-afe22de3-9e19-43d0-bb0d-f2a705a23819 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:31.440398 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-afe22de3-9e19-43d0-bb0d-f2a705a23819 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:31.440941 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-afe22de3-9e19-43d0-bb0d-f2a705a23819 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:31.476626 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-afe22de3-9e19-43d0-bb0d-f2a705a23819 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051454 Jun 22 10:31:31.477231 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 460/900] 10.222.0.66 () {58 vars in 1301 bytes} [Wed Jun 22 10:31:31 2022] GET /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:31:31.487965 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-fdc89ee8-8a47-43eb-a8b6-b34b2f707ab7 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:31.488466 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-fdc89ee8-8a47-43eb-a8b6-b34b2f707ab7 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: a1520a14-618c-4e2d-b20d-a08ebd9f6daa] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:31.495597 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-fdc89ee8-8a47-43eb-a8b6-b34b2f707ab7 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:31.496159 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-fdc89ee8-8a47-43eb-a8b6-b34b2f707ab7 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:31.496847 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-fdc89ee8-8a47-43eb-a8b6-b34b2f707ab7 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:31.497311 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-fdc89ee8-8a47-43eb-a8b6-b34b2f707ab7 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:31.530061 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-fdc89ee8-8a47-43eb-a8b6-b34b2f707ab7 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa/os-volume_attachments/f5db5b49-6662-45e5-a150-29c6b465175f" status: 200 len: 194 microversion: 2.1 time: 0.046329 Jun 22 10:31:31.530737 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 441/901] 10.222.0.66 () {58 vars in 1412 bytes} [Wed Jun 22 10:31:31 2022] GET /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa/os-volume_attachments/f5db5b49-6662-45e5-a150-29c6b465175f => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:31:32.304403 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-7cedf89e-e689-4a7b-b088-8a1b340ab69c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:32.305018 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-7cedf89e-e689-4a7b-b088-8a1b340ab69c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:32.312265 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7cedf89e-e689-4a7b-b088-8a1b340ab69c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:32.312710 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7cedf89e-e689-4a7b-b088-8a1b340ab69c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:32.313508 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7cedf89e-e689-4a7b-b088-8a1b340ab69c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:32.313992 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7cedf89e-e689-4a7b-b088-8a1b340ab69c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:32.465501 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-7cedf89e-e689-4a7b-b088-8a1b340ab69c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:32.480062 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-7cedf89e-e689-4a7b-b088-8a1b340ab69c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:32.483159 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-7cedf89e-e689-4a7b-b088-8a1b340ab69c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:32.485143 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-7cedf89e-e689-4a7b-b088-8a1b340ab69c tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1730 microversion: 2.20 time: 0.184569 Jun 22 10:31:32.486169 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 461/902] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:31:32 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1730 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:31:32.927817 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-d36d53e5-1b77-4c28-8676-117da7dc6705 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f76a40af-f79a-47d4-9a72-550b3308a8de"}} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:31:32.930027 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-d36d53e5-1b77-4c28-8676-117da7dc6705 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: a1520a14-618c-4e2d-b20d-a08ebd9f6daa] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:32.942378 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d36d53e5-1b77-4c28-8676-117da7dc6705 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:32.943250 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d36d53e5-1b77-4c28-8676-117da7dc6705 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:32.944672 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d36d53e5-1b77-4c28-8676-117da7dc6705 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:32.945446 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d36d53e5-1b77-4c28-8676-117da7dc6705 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:32.972887 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:31:33.246831 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-d36d53e5-1b77-4c28-8676-117da7dc6705 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "POST /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.327026 Jun 22 10:31:33.247457 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 442/903] 10.222.0.66 () {60 vars in 1322 bytes} [Wed Jun 22 10:31:32 2022] POST /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa/os-volume_attachments => generated 194 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:31:33.516563 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-e16fdcb3-2035-4b67-852c-9d1d3e134ee2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:33.518753 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-e16fdcb3-2035-4b67-852c-9d1d3e134ee2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:33.529025 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e16fdcb3-2035-4b67-852c-9d1d3e134ee2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:33.529610 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e16fdcb3-2035-4b67-852c-9d1d3e134ee2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:33.530493 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e16fdcb3-2035-4b67-852c-9d1d3e134ee2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:33.531034 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e16fdcb3-2035-4b67-852c-9d1d3e134ee2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:33.674080 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-e16fdcb3-2035-4b67-852c-9d1d3e134ee2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:33.683720 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-e16fdcb3-2035-4b67-852c-9d1d3e134ee2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:33.685508 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-e16fdcb3-2035-4b67-852c-9d1d3e134ee2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:33.687139 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-e16fdcb3-2035-4b67-852c-9d1d3e134ee2 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1730 microversion: 2.20 time: 0.177957 Jun 22 10:31:33.687925 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 462/904] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:31:33 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1730 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:31:34.707336 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-74e7e3ab-9f05-45fd-86a0-33d1c387fc7b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:34.708121 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-74e7e3ab-9f05-45fd-86a0-33d1c387fc7b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:34.715739 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-74e7e3ab-9f05-45fd-86a0-33d1c387fc7b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:34.716169 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-74e7e3ab-9f05-45fd-86a0-33d1c387fc7b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:34.717033 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-74e7e3ab-9f05-45fd-86a0-33d1c387fc7b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:34.717508 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-74e7e3ab-9f05-45fd-86a0-33d1c387fc7b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:34.871077 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-74e7e3ab-9f05-45fd-86a0-33d1c387fc7b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:34.880084 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-74e7e3ab-9f05-45fd-86a0-33d1c387fc7b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:34.881640 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-74e7e3ab-9f05-45fd-86a0-33d1c387fc7b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:34.882875 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-74e7e3ab-9f05-45fd-86a0-33d1c387fc7b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1730 microversion: 2.20 time: 0.180243 Jun 22 10:31:34.883461 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 443/905] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:31:34 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1730 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:31:35.083845 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-e5eaa86a-cae3-4965-bb07-06dfbc85b4ef req-50fb887d-7395-4b70-9235-7f001b3a41c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d288ac1d-ffb9-4ac1-a5a4-095bf673cea0", "name": "network-vif-plugged", "status": "completed", "tag": "41f6ee40-8d5d-4ffb-b909-afe6a1d8f347"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:31:35.092980 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-e5eaa86a-cae3-4965-bb07-06dfbc85b4ef req-50fb887d-7395-4b70-9235-7f001b3a41c4 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:35.093435 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-e5eaa86a-cae3-4965-bb07-06dfbc85b4ef req-50fb887d-7395-4b70-9235-7f001b3a41c4 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:35.107616 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-e5eaa86a-cae3-4965-bb07-06dfbc85b4ef req-50fb887d-7395-4b70-9235-7f001b3a41c4 service nova] Creating event network-vif-plugged:41f6ee40-8d5d-4ffb-b909-afe6a1d8f347 for instance d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 on hv-cinder-84713 Jun 22 10:31:35.113355 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-e5eaa86a-cae3-4965-bb07-06dfbc85b4ef req-50fb887d-7395-4b70-9235-7f001b3a41c4 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133149 Jun 22 10:31:35.114003 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 463/906] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:31:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:31:35.902714 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-594f6c9a-fcbf-4bd8-bdba-e864a696111f tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:35.903359 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-594f6c9a-fcbf-4bd8-bdba-e864a696111f tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:35.910719 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-594f6c9a-fcbf-4bd8-bdba-e864a696111f tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:35.911181 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-594f6c9a-fcbf-4bd8-bdba-e864a696111f tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:35.911969 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-594f6c9a-fcbf-4bd8-bdba-e864a696111f tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:35.912406 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-594f6c9a-fcbf-4bd8-bdba-e864a696111f tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:36.070469 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-594f6c9a-fcbf-4bd8-bdba-e864a696111f tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:36.080043 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-594f6c9a-fcbf-4bd8-bdba-e864a696111f tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:36.081687 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-594f6c9a-fcbf-4bd8-bdba-e864a696111f tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:36.082951 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-594f6c9a-fcbf-4bd8-bdba-e864a696111f tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1730 microversion: 2.20 time: 0.185032 Jun 22 10:31:36.083532 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 444/907] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:31:35 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1730 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:31:37.104636 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-d5423b49-2c2b-4069-a18f-56bb305adf3a tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:37.105541 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-d5423b49-2c2b-4069-a18f-56bb305adf3a tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:37.113044 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d5423b49-2c2b-4069-a18f-56bb305adf3a tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:37.113493 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d5423b49-2c2b-4069-a18f-56bb305adf3a tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:37.114287 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d5423b49-2c2b-4069-a18f-56bb305adf3a tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:37.114753 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d5423b49-2c2b-4069-a18f-56bb305adf3a tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:37.312806 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-d5423b49-2c2b-4069-a18f-56bb305adf3a tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:37.330619 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-d5423b49-2c2b-4069-a18f-56bb305adf3a tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:37.335729 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-d5423b49-2c2b-4069-a18f-56bb305adf3a tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:37.340127 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-d5423b49-2c2b-4069-a18f-56bb305adf3a tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1730 microversion: 2.20 time: 0.240036 Jun 22 10:31:37.342144 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 464/908] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:31:37 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1730 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:31:38.364022 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-980de9f3-8039-41bd-bada-53cfbc48f474 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:38.364802 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-980de9f3-8039-41bd-bada-53cfbc48f474 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:38.372363 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-980de9f3-8039-41bd-bada-53cfbc48f474 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:38.372780 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-980de9f3-8039-41bd-bada-53cfbc48f474 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:38.373594 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-980de9f3-8039-41bd-bada-53cfbc48f474 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:38.374035 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-980de9f3-8039-41bd-bada-53cfbc48f474 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:38.532157 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-980de9f3-8039-41bd-bada-53cfbc48f474 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:38.542118 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-980de9f3-8039-41bd-bada-53cfbc48f474 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:38.543865 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-980de9f3-8039-41bd-bada-53cfbc48f474 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:38.545306 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-980de9f3-8039-41bd-bada-53cfbc48f474 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1717 microversion: 2.20 time: 0.185896 Jun 22 10:31:38.546020 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 445/909] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:31:38 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1717 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:31:40.910706 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-84caffaf-d015-4bda-af02-287ff8e4c4fc tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:40.911704 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-84caffaf-d015-4bda-af02-287ff8e4c4fc tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: a1520a14-618c-4e2d-b20d-a08ebd9f6daa] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:40.914550 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_api:SELECT=28 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:31:40.921001 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-84caffaf-d015-4bda-af02-287ff8e4c4fc tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:40.921446 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-84caffaf-d015-4bda-af02-287ff8e4c4fc tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:40.922252 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-84caffaf-d015-4bda-af02-287ff8e4c4fc tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:40.922739 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-84caffaf-d015-4bda-af02-287ff8e4c4fc tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:40.959764 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-84caffaf-d015-4bda-af02-287ff8e4c4fc tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.053438 Jun 22 10:31:40.960363 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 465/910] 10.222.0.66 () {58 vars in 1301 bytes} [Wed Jun 22 10:31:40 2022] GET /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa/os-volume_attachments => generated 371 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:31:41.103792 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-129cfb81-a01e-43d9-af29-4c116989dbf1 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:41.104522 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-129cfb81-a01e-43d9-af29-4c116989dbf1 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: a1520a14-618c-4e2d-b20d-a08ebd9f6daa] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:41.116562 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-129cfb81-a01e-43d9-af29-4c116989dbf1 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:41.117328 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-129cfb81-a01e-43d9-af29-4c116989dbf1 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:41.118736 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-129cfb81-a01e-43d9-af29-4c116989dbf1 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:41.119480 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-129cfb81-a01e-43d9-af29-4c116989dbf1 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:41.157839 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-129cfb81-a01e-43d9-af29-4c116989dbf1 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa/os-volume_attachments/f5db5b49-6662-45e5-a150-29c6b465175f" status: 200 len: 194 microversion: 2.1 time: 0.061676 Jun 22 10:31:41.158548 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 446/911] 10.222.0.66 () {58 vars in 1412 bytes} [Wed Jun 22 10:31:41 2022] GET /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa/os-volume_attachments/f5db5b49-6662-45e5-a150-29c6b465175f => generated 194 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:31:41.169938 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-0f011ebc-7745-4bc2-9fe0-5d7f8118a624 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:41.170447 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-0f011ebc-7745-4bc2-9fe0-5d7f8118a624 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: a1520a14-618c-4e2d-b20d-a08ebd9f6daa] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:41.178115 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0f011ebc-7745-4bc2-9fe0-5d7f8118a624 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:41.178756 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0f011ebc-7745-4bc2-9fe0-5d7f8118a624 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:41.179609 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0f011ebc-7745-4bc2-9fe0-5d7f8118a624 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:41.180222 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0f011ebc-7745-4bc2-9fe0-5d7f8118a624 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:41.279962 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.objects.instance [None req-0f011ebc-7745-4bc2-9fe0-5d7f8118a624 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lazy-loading 'services' on Instance uuid a1520a14-618c-4e2d-b20d-a08ebd9f6daa {{(pid=117680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:31:41.368786 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-0f011ebc-7745-4bc2-9fe0-5d7f8118a624 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "DELETE /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa/os-volume_attachments/f5db5b49-6662-45e5-a150-29c6b465175f" status: 202 len: 0 microversion: 2.1 time: 0.203269 Jun 22 10:31:41.369451 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 466/912] 10.222.0.66 () {58 vars in 1415 bytes} [Wed Jun 22 10:31:41 2022] DELETE /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa/os-volume_attachments/f5db5b49-6662-45e5-a150-29c6b465175f => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:31:43.628023 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-f30c6f6f-a31d-40b6-ad39-921c68e74e20 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:43.628823 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-f30c6f6f-a31d-40b6-ad39-921c68e74e20 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: a1520a14-618c-4e2d-b20d-a08ebd9f6daa] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:43.631430 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_api:SELECT=30 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:31:43.637517 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f30c6f6f-a31d-40b6-ad39-921c68e74e20 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:43.637972 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f30c6f6f-a31d-40b6-ad39-921c68e74e20 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:43.638810 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f30c6f6f-a31d-40b6-ad39-921c68e74e20 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:43.639248 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f30c6f6f-a31d-40b6-ad39-921c68e74e20 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:43.675562 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-f30c6f6f-a31d-40b6-ad39-921c68e74e20 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa/os-volume_attachments/f76a40af-f79a-47d4-9a72-550b3308a8de" status: 200 len: 194 microversion: 2.1 time: 0.051571 Jun 22 10:31:43.676153 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 447/913] 10.222.0.66 () {58 vars in 1412 bytes} [Wed Jun 22 10:31:43 2022] GET /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa/os-volume_attachments/f76a40af-f79a-47d4-9a72-550b3308a8de => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:31:43.688607 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-060f7f9d-4075-452f-a9d4-53ce5922e187 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:43.689206 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-060f7f9d-4075-452f-a9d4-53ce5922e187 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: a1520a14-618c-4e2d-b20d-a08ebd9f6daa] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:43.696005 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-060f7f9d-4075-452f-a9d4-53ce5922e187 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:43.696450 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-060f7f9d-4075-452f-a9d4-53ce5922e187 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:43.697244 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-060f7f9d-4075-452f-a9d4-53ce5922e187 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:43.697675 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-060f7f9d-4075-452f-a9d4-53ce5922e187 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:43.700788 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=1 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:31:43.793230 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.objects.instance [None req-060f7f9d-4075-452f-a9d4-53ce5922e187 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lazy-loading 'services' on Instance uuid a1520a14-618c-4e2d-b20d-a08ebd9f6daa {{(pid=117680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:31:43.883544 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-060f7f9d-4075-452f-a9d4-53ce5922e187 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "DELETE /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa/os-volume_attachments/f76a40af-f79a-47d4-9a72-550b3308a8de" status: 202 len: 0 microversion: 2.1 time: 0.200011 Jun 22 10:31:43.884374 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 467/914] 10.222.0.66 () {58 vars in 1415 bytes} [Wed Jun 22 10:31:43 2022] DELETE /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa/os-volume_attachments/f76a40af-f79a-47d4-9a72-550b3308a8de => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:31:45.085366 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-f77ade53-8970-40a9-94fe-877e787b8034 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:45.086369 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-f77ade53-8970-40a9-94fe-877e787b8034 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: a1520a14-618c-4e2d-b20d-a08ebd9f6daa] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:45.093675 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f77ade53-8970-40a9-94fe-877e787b8034 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:45.094119 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f77ade53-8970-40a9-94fe-877e787b8034 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:45.094990 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f77ade53-8970-40a9-94fe-877e787b8034 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:45.095426 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f77ade53-8970-40a9-94fe-877e787b8034 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:45.129275 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-f77ade53-8970-40a9-94fe-877e787b8034 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047865 Jun 22 10:31:45.129887 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 448/915] 10.222.0.66 () {58 vars in 1301 bytes} [Wed Jun 22 10:31:45 2022] GET /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 22 10:31:45.263622 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-792015fc-7e5b-4111-8754-9fbca96c55f3 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:45.264784 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-792015fc-7e5b-4111-8754-9fbca96c55f3 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: a1520a14-618c-4e2d-b20d-a08ebd9f6daa] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:45.272009 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-792015fc-7e5b-4111-8754-9fbca96c55f3 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:45.272466 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-792015fc-7e5b-4111-8754-9fbca96c55f3 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:45.273372 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-792015fc-7e5b-4111-8754-9fbca96c55f3 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:45.273809 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-792015fc-7e5b-4111-8754-9fbca96c55f3 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:45.307701 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-792015fc-7e5b-4111-8754-9fbca96c55f3 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049384 Jun 22 10:31:45.308290 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 468/916] 10.222.0.66 () {58 vars in 1301 bytes} [Wed Jun 22 10:31:45 2022] GET /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 22 10:31:45.385908 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-926c1d59-17cc-4226-b698-aa21448ad651 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:45.386692 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-926c1d59-17cc-4226-b698-aa21448ad651 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: a1520a14-618c-4e2d-b20d-a08ebd9f6daa] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:45.395546 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-926c1d59-17cc-4226-b698-aa21448ad651 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:45.396006 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-926c1d59-17cc-4226-b698-aa21448ad651 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:45.396882 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-926c1d59-17cc-4226-b698-aa21448ad651 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:45.397302 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-926c1d59-17cc-4226-b698-aa21448ad651 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:45.426797 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-926c1d59-17cc-4226-b698-aa21448ad651 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: a1520a14-618c-4e2d-b20d-a08ebd9f6daa] Going to try to terminate instance {{(pid=117679) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 10:31:45.521636 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-926c1d59-17cc-4226-b698-aa21448ad651 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "DELETE /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa" status: 204 len: 0 microversion: 2.1 time: 0.139334 Jun 22 10:31:45.522864 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 449/917] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Jun 22 10:31:45 2022] DELETE /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 10:31:45.531866 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-f840e4c8-644d-444e-94cc-399a85e0338a tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:45.532474 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-f840e4c8-644d-444e-94cc-399a85e0338a tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: a1520a14-618c-4e2d-b20d-a08ebd9f6daa] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:45.539083 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f840e4c8-644d-444e-94cc-399a85e0338a tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:45.539538 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f840e4c8-644d-444e-94cc-399a85e0338a tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:45.540320 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f840e4c8-644d-444e-94cc-399a85e0338a tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:45.540755 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f840e4c8-644d-444e-94cc-399a85e0338a tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:45.688056 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-f840e4c8-644d-444e-94cc-399a85e0338a tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:45.696889 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-f840e4c8-644d-444e-94cc-399a85e0338a tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa" status: 200 len: 1670 microversion: 2.1 time: 0.169395 Jun 22 10:31:45.697602 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 469/918] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:31:45 2022] GET /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa => generated 1670 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:31:46.716734 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-7b470b34-f005-4488-9364-e35f7dea0000 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:46.717491 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-7b470b34-f005-4488-9364-e35f7dea0000 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: a1520a14-618c-4e2d-b20d-a08ebd9f6daa] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:46.724770 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7b470b34-f005-4488-9364-e35f7dea0000 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:46.725201 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7b470b34-f005-4488-9364-e35f7dea0000 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:46.725980 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7b470b34-f005-4488-9364-e35f7dea0000 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:46.726424 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7b470b34-f005-4488-9364-e35f7dea0000 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:46.884578 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-7b470b34-f005-4488-9364-e35f7dea0000 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:46.893234 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-7b470b34-f005-4488-9364-e35f7dea0000 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa" status: 200 len: 1670 microversion: 2.1 time: 0.180958 Jun 22 10:31:46.893836 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 450/919] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:31:46 2022] GET /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa => generated 1670 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:31:47.918339 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-0077506d-451a-4b6c-afcf-5ac7be84048f tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:47.919157 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-0077506d-451a-4b6c-afcf-5ac7be84048f tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: a1520a14-618c-4e2d-b20d-a08ebd9f6daa] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:47.926626 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0077506d-451a-4b6c-afcf-5ac7be84048f tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:47.927100 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0077506d-451a-4b6c-afcf-5ac7be84048f tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:47.927967 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0077506d-451a-4b6c-afcf-5ac7be84048f tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:47.928443 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0077506d-451a-4b6c-afcf-5ac7be84048f tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:48.124411 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-0077506d-451a-4b6c-afcf-5ac7be84048f tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:48.135322 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-0077506d-451a-4b6c-afcf-5ac7be84048f tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa" status: 200 len: 1670 microversion: 2.1 time: 0.221330 Jun 22 10:31:48.135903 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 470/920] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:31:47 2022] GET /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa => generated 1670 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:31:48.887675 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-e890f3bc-1512-45c3-b6fd-0a4e071d85f0 req-3aa4342b-4cf9-490b-9aad-53481cf0bc38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1520a14-618c-4e2d-b20d-a08ebd9f6daa", "name": "network-vif-deleted", "tag": "f2855566-99ba-4484-9767-575224b0c7dc"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:31:48.911623 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-e890f3bc-1512-45c3-b6fd-0a4e071d85f0 req-3aa4342b-4cf9-490b-9aad-53481cf0bc38 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:48.912479 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-e890f3bc-1512-45c3-b6fd-0a4e071d85f0 req-3aa4342b-4cf9-490b-9aad-53481cf0bc38 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:48.929773 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-e890f3bc-1512-45c3-b6fd-0a4e071d85f0 req-3aa4342b-4cf9-490b-9aad-53481cf0bc38 service nova] Creating event network-vif-deleted:f2855566-99ba-4484-9767-575224b0c7dc for instance a1520a14-618c-4e2d-b20d-a08ebd9f6daa on hv-cinder-84713 Jun 22 10:31:48.938075 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-e890f3bc-1512-45c3-b6fd-0a4e071d85f0 req-3aa4342b-4cf9-490b-9aad-53481cf0bc38 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056973 Jun 22 10:31:48.942493 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 451/921] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:31:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:31:49.153823 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-ab8c6f1d-cba5-4c8f-87ae-227aa58f6cf0 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:49.154596 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-ab8c6f1d-cba5-4c8f-87ae-227aa58f6cf0 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: a1520a14-618c-4e2d-b20d-a08ebd9f6daa] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:49.162847 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ab8c6f1d-cba5-4c8f-87ae-227aa58f6cf0 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:49.163316 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ab8c6f1d-cba5-4c8f-87ae-227aa58f6cf0 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:49.164163 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ab8c6f1d-cba5-4c8f-87ae-227aa58f6cf0 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:49.164631 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ab8c6f1d-cba5-4c8f-87ae-227aa58f6cf0 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:49.207191 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ab8c6f1d-cba5-4c8f-87ae-227aa58f6cf0 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:49.207826 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ab8c6f1d-cba5-4c8f-87ae-227aa58f6cf0 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:49.208385 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.objects.instance [None req-ab8c6f1d-cba5-4c8f-87ae-227aa58f6cf0 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lazy-loading 'fault' on Instance uuid a1520a14-618c-4e2d-b20d-a08ebd9f6daa {{(pid=117680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:31:49.255626 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-ab8c6f1d-cba5-4c8f-87ae-227aa58f6cf0 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '595531abf958489795f2363026697a5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fecb66f4a7094cd3963caf460c52b88b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:31:49.265089 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-ab8c6f1d-cba5-4c8f-87ae-227aa58f6cf0 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa" status: 200 len: 1326 microversion: 2.1 time: 0.116179 Jun 22 10:31:49.265711 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 471/922] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:31:49 2022] GET /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa => generated 1326 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:31:50.286202 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-1a6368fe-0806-4287-af29-3da86f3f651a tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:50.287086 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-1a6368fe-0806-4287-af29-3da86f3f651a tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: a1520a14-618c-4e2d-b20d-a08ebd9f6daa] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:50.294759 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1a6368fe-0806-4287-af29-3da86f3f651a tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:50.295459 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1a6368fe-0806-4287-af29-3da86f3f651a tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:50.296447 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1a6368fe-0806-4287-af29-3da86f3f651a tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:50.297081 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1a6368fe-0806-4287-af29-3da86f3f651a tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:50.314492 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.wsgi [None req-1a6368fe-0806-4287-af29-3da86f3f651a tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] HTTP exception thrown: Instance a1520a14-618c-4e2d-b20d-a08ebd9f6daa could not be found. Jun 22 10:31:50.316612 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-1a6368fe-0806-4287-af29-3da86f3f651a tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Request method failure captured: Jun 22 10:31:50.316612 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: request: GET /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa HTTP/1.1 Jun 22 10:31:50.316612 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Accept: application/json Jun 22 10:31:50.316612 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Accept-Encoding: identity Jun 22 10:31:50.316612 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Connection: close Jun 22 10:31:50.316612 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Content-Length: 0 Jun 22 10:31:50.316612 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Content-Type: application/json Jun 22 10:31:50.316612 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Host: 10.222.0.66 Jun 22 10:31:50.316612 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Openstack-System-Scope: None Jun 22 10:31:50.316612 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: User-Agent: python-urllib3/1.26.9 Jun 22 10:31:50.316612 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Auth-Token: gAAAAABisu0BnE_6QJsexpU7NTJiv_Hqc8o3PmmQ7QZO72blyC_knl60ZrRuGijGZKHl9RR5uw4zHVvsp88mzHQfFz3yJPSm3wXa4GqXjc6Bzt_tqISAmWw_LHmOpybPJrtZUCxW67BMwQK-TIX_sxqI_elHLkYwKszKeVwHg9aHgSGQXB6cYVM Jun 22 10:31:50.316612 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Domain-Id: None Jun 22 10:31:50.316612 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Domain-Name: None Jun 22 10:31:50.316612 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Identity-Status: Confirmed Jun 22 10:31:50.316612 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Is-Admin-Project: True Jun 22 10:31:50.316612 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Domain-Id: default Jun 22 10:31:50.316612 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Domain-Name: Default Jun 22 10:31:50.316612 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Id: fecb66f4a7094cd3963caf460c52b88b Jun 22 10:31:50.316612 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Name: tempest-AttachVolumeTestJSON-986519348 Jun 22 10:31:50.316612 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Role: member,reader Jun 22 10:31:50.316612 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Roles: member,reader Jun 22 10:31:50.319677 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_fecb66f4a7094cd3963caf460c52b88b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/fecb66f4a7094cd3963caf460c52b88b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/fecb66f4a7094cd3963caf460c52b88b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/fecb66f4a7094cd3963caf460c52b88b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}] Jun 22 10:31:50.319677 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Tenant: tempest-AttachVolumeTestJSON-986519348 Jun 22 10:31:50.319677 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Tenant-Id: fecb66f4a7094cd3963caf460c52b88b Jun 22 10:31:50.319677 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Tenant-Name: tempest-AttachVolumeTestJSON-986519348 Jun 22 10:31:50.319677 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User: tempest-AttachVolumeTestJSON-986519348-project Jun 22 10:31:50.319677 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Domain-Id: default Jun 22 10:31:50.319677 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Domain-Name: Default Jun 22 10:31:50.319677 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Id: 595531abf958489795f2363026697a5b Jun 22 10:31:50.319677 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Name: tempest-AttachVolumeTestJSON-986519348-project Jun 22 10:31:50.319677 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: method: > Jun 22 10:31:50.319677 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: exception: Instance a1520a14-618c-4e2d-b20d-a08ebd9f6daa could not be found. Jun 22 10:31:50.319677 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: action_args: {'id': 'a1520a14-618c-4e2d-b20d-a08ebd9f6daa'} Jun 22 10:31:50.321889 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:31:50.321889 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:31:50.321889 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:31:50.321889 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:31:50.321889 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:31:50.321889 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:31:50.321889 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:31:50.321889 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:31:50.321889 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:31:50.321889 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:31:50.321889 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1520a14-618c-4e2d-b20d-a08ebd9f6daa could not be found. Jun 22 10:31:50.321889 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:31:50.321889 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:31:50.321889 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:31:50.321889 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:31:50.321889 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:31:50.321889 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:31:50.321889 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:31:50.321889 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:31:50.321889 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:31:50.326107 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:31:50.326107 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:31:50.326107 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:31:50.326107 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:31:50.326107 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:31:50.326107 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:31:50.326107 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:31:50.326107 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1520a14-618c-4e2d-b20d-a08ebd9f6daa could not be found. Jun 22 10:31:50.326107 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:31:50.326107 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:31:50.326107 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:31:50.326107 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:31:50.326107 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:31:50.326107 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:31:50.326107 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:31:50.326107 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:31:50.326107 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1520a14-618c-4e2d-b20d-a08ebd9f6daa could not be found. Jun 22 10:31:50.326107 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:31:50.328860 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-1a6368fe-0806-4287-af29-3da86f3f651a tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Returning 404 to user: Instance a1520a14-618c-4e2d-b20d-a08ebd9f6daa could not be found. {{(pid=117679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:31:50.328860 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-1a6368fe-0806-4287-af29-3da86f3f651a tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa" status: 404 len: 111 microversion: 2.1 time: 0.038937 Jun 22 10:31:50.328860 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 452/923] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:31:50 2022] GET /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:31:50.331586 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-e4098cba-d603-4219-9234-5fe0e183d80c tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '.version_select at 0x7f60d96dc4c0>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:50.356907 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-e4098cba-d603-4219-9234-5fe0e183d80c tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-144009232" status: 202 len: 0 microversion: 2.1 time: 0.029216 Jun 22 10:31:50.357947 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 472/924] 10.222.0.66 () {58 vars in 1217 bytes} [Wed Jun 22 10:31:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-144009232 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 22 10:31:53.522434 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-788f44a2-b94e-49de-9b96-195c39ac34cf tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:53.523117 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-788f44a2-b94e-49de-9b96-195c39ac34cf tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: a1520a14-618c-4e2d-b20d-a08ebd9f6daa] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:53.531111 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-788f44a2-b94e-49de-9b96-195c39ac34cf tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:53.531574 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-788f44a2-b94e-49de-9b96-195c39ac34cf tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:53.532403 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-788f44a2-b94e-49de-9b96-195c39ac34cf tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:53.532869 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-788f44a2-b94e-49de-9b96-195c39ac34cf tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:53.548563 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.wsgi [None req-788f44a2-b94e-49de-9b96-195c39ac34cf tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] HTTP exception thrown: Instance a1520a14-618c-4e2d-b20d-a08ebd9f6daa could not be found. Jun 22 10:31:53.550178 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-788f44a2-b94e-49de-9b96-195c39ac34cf tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Request method failure captured: Jun 22 10:31:53.550178 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: request: DELETE /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa HTTP/1.1 Jun 22 10:31:53.550178 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Accept: application/json Jun 22 10:31:53.550178 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Accept-Encoding: identity Jun 22 10:31:53.550178 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Connection: close Jun 22 10:31:53.550178 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Content-Length: 0 Jun 22 10:31:53.550178 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Content-Type: application/json Jun 22 10:31:53.550178 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Host: 10.222.0.66 Jun 22 10:31:53.550178 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Openstack-System-Scope: None Jun 22 10:31:53.550178 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: User-Agent: python-urllib3/1.26.9 Jun 22 10:31:53.550178 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Auth-Token: gAAAAABisu0BnE_6QJsexpU7NTJiv_Hqc8o3PmmQ7QZO72blyC_knl60ZrRuGijGZKHl9RR5uw4zHVvsp88mzHQfFz3yJPSm3wXa4GqXjc6Bzt_tqISAmWw_LHmOpybPJrtZUCxW67BMwQK-TIX_sxqI_elHLkYwKszKeVwHg9aHgSGQXB6cYVM Jun 22 10:31:53.550178 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Domain-Id: None Jun 22 10:31:53.550178 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Domain-Name: None Jun 22 10:31:53.550178 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Identity-Status: Confirmed Jun 22 10:31:53.550178 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Is-Admin-Project: True Jun 22 10:31:53.550178 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Domain-Id: default Jun 22 10:31:53.550178 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Domain-Name: Default Jun 22 10:31:53.550178 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Id: fecb66f4a7094cd3963caf460c52b88b Jun 22 10:31:53.550178 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Name: tempest-AttachVolumeTestJSON-986519348 Jun 22 10:31:53.550178 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Role: member,reader Jun 22 10:31:53.550178 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Roles: member,reader Jun 22 10:31:53.552208 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_fecb66f4a7094cd3963caf460c52b88b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/fecb66f4a7094cd3963caf460c52b88b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/fecb66f4a7094cd3963caf460c52b88b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/fecb66f4a7094cd3963caf460c52b88b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}] Jun 22 10:31:53.552208 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Tenant: tempest-AttachVolumeTestJSON-986519348 Jun 22 10:31:53.552208 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Tenant-Id: fecb66f4a7094cd3963caf460c52b88b Jun 22 10:31:53.552208 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Tenant-Name: tempest-AttachVolumeTestJSON-986519348 Jun 22 10:31:53.552208 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User: tempest-AttachVolumeTestJSON-986519348-project Jun 22 10:31:53.552208 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Domain-Id: default Jun 22 10:31:53.552208 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Domain-Name: Default Jun 22 10:31:53.552208 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Id: 595531abf958489795f2363026697a5b Jun 22 10:31:53.552208 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Name: tempest-AttachVolumeTestJSON-986519348-project Jun 22 10:31:53.552208 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: method: > Jun 22 10:31:53.552208 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: exception: Instance a1520a14-618c-4e2d-b20d-a08ebd9f6daa could not be found. Jun 22 10:31:53.552208 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: action_args: {'id': 'a1520a14-618c-4e2d-b20d-a08ebd9f6daa'} Jun 22 10:31:53.553773 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:31:53.553773 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:31:53.553773 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:31:53.553773 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:31:53.553773 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:31:53.553773 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:31:53.553773 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:31:53.553773 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:31:53.553773 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:31:53.553773 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:31:53.553773 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1520a14-618c-4e2d-b20d-a08ebd9f6daa could not be found. Jun 22 10:31:53.553773 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:31:53.553773 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:31:53.553773 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:31:53.553773 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:31:53.553773 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:31:53.553773 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:31:53.553773 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:31:53.553773 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:31:53.553773 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:31:53.556440 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:31:53.556440 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 10:31:53.556440 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 10:31:53.556440 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 10:31:53.556440 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 10:31:53.556440 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:31:53.556440 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:31:53.556440 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:31:53.556440 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:31:53.556440 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1520a14-618c-4e2d-b20d-a08ebd9f6daa could not be found. Jun 22 10:31:53.556440 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:31:53.556440 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:31:53.556440 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:31:53.556440 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:31:53.556440 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:31:53.556440 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:31:53.556440 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:31:53.556440 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:31:53.556440 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1520a14-618c-4e2d-b20d-a08ebd9f6daa could not be found. Jun 22 10:31:53.556440 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:31:53.559132 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-788f44a2-b94e-49de-9b96-195c39ac34cf tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Returning 404 to user: Instance a1520a14-618c-4e2d-b20d-a08ebd9f6daa could not be found. {{(pid=117679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:31:53.559132 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-788f44a2-b94e-49de-9b96-195c39ac34cf tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "DELETE /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa" status: 404 len: 111 microversion: 2.1 time: 0.033427 Jun 22 10:31:53.559132 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 453/925] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Jun 22 10:31:53 2022] DELETE /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:31:53.564374 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-4adf563b-5e9f-45c2-9385-c47cdcb3a6a2 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:53.565006 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-4adf563b-5e9f-45c2-9385-c47cdcb3a6a2 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: a1520a14-618c-4e2d-b20d-a08ebd9f6daa] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:53.571995 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4adf563b-5e9f-45c2-9385-c47cdcb3a6a2 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:53.572453 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4adf563b-5e9f-45c2-9385-c47cdcb3a6a2 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:53.573266 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4adf563b-5e9f-45c2-9385-c47cdcb3a6a2 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:53.573712 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4adf563b-5e9f-45c2-9385-c47cdcb3a6a2 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:53.750637 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.wsgi [None req-4adf563b-5e9f-45c2-9385-c47cdcb3a6a2 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] HTTP exception thrown: Instance a1520a14-618c-4e2d-b20d-a08ebd9f6daa could not be found. Jun 22 10:31:53.752302 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-4adf563b-5e9f-45c2-9385-c47cdcb3a6a2 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Request method failure captured: Jun 22 10:31:53.752302 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: request: GET /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa HTTP/1.1 Jun 22 10:31:53.752302 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Accept: application/json Jun 22 10:31:53.752302 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Accept-Encoding: identity Jun 22 10:31:53.752302 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Connection: close Jun 22 10:31:53.752302 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Content-Length: 0 Jun 22 10:31:53.752302 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Content-Type: application/json Jun 22 10:31:53.752302 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Host: 10.222.0.66 Jun 22 10:31:53.752302 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Openstack-System-Scope: None Jun 22 10:31:53.752302 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: User-Agent: python-urllib3/1.26.9 Jun 22 10:31:53.752302 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Auth-Token: gAAAAABisu0BnE_6QJsexpU7NTJiv_Hqc8o3PmmQ7QZO72blyC_knl60ZrRuGijGZKHl9RR5uw4zHVvsp88mzHQfFz3yJPSm3wXa4GqXjc6Bzt_tqISAmWw_LHmOpybPJrtZUCxW67BMwQK-TIX_sxqI_elHLkYwKszKeVwHg9aHgSGQXB6cYVM Jun 22 10:31:53.752302 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Domain-Id: None Jun 22 10:31:53.752302 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Domain-Name: None Jun 22 10:31:53.752302 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Identity-Status: Confirmed Jun 22 10:31:53.752302 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Is-Admin-Project: True Jun 22 10:31:53.752302 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Domain-Id: default Jun 22 10:31:53.752302 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Domain-Name: Default Jun 22 10:31:53.752302 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Id: fecb66f4a7094cd3963caf460c52b88b Jun 22 10:31:53.752302 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Name: tempest-AttachVolumeTestJSON-986519348 Jun 22 10:31:53.752302 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Role: member,reader Jun 22 10:31:53.752302 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Roles: member,reader Jun 22 10:31:53.754635 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_fecb66f4a7094cd3963caf460c52b88b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/fecb66f4a7094cd3963caf460c52b88b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/fecb66f4a7094cd3963caf460c52b88b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/fecb66f4a7094cd3963caf460c52b88b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}] Jun 22 10:31:53.754635 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant: tempest-AttachVolumeTestJSON-986519348 Jun 22 10:31:53.754635 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant-Id: fecb66f4a7094cd3963caf460c52b88b Jun 22 10:31:53.754635 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant-Name: tempest-AttachVolumeTestJSON-986519348 Jun 22 10:31:53.754635 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User: tempest-AttachVolumeTestJSON-986519348-project Jun 22 10:31:53.754635 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Domain-Id: default Jun 22 10:31:53.754635 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Domain-Name: Default Jun 22 10:31:53.754635 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Id: 595531abf958489795f2363026697a5b Jun 22 10:31:53.754635 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Name: tempest-AttachVolumeTestJSON-986519348-project Jun 22 10:31:53.754635 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: method: > Jun 22 10:31:53.754635 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: exception: Instance a1520a14-618c-4e2d-b20d-a08ebd9f6daa could not be found. Jun 22 10:31:53.754635 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: action_args: {'id': 'a1520a14-618c-4e2d-b20d-a08ebd9f6daa'} Jun 22 10:31:53.755750 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:31:53.755750 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:31:53.755750 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:31:53.755750 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:31:53.755750 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:31:53.755750 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:31:53.755750 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:31:53.755750 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:31:53.755750 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:31:53.755750 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:31:53.755750 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1520a14-618c-4e2d-b20d-a08ebd9f6daa could not be found. Jun 22 10:31:53.755750 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:31:53.755750 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:31:53.755750 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:31:53.755750 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:31:53.755750 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:31:53.755750 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:31:53.755750 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:31:53.755750 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:31:53.755750 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:31:53.757174 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:31:53.757174 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:31:53.757174 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:31:53.757174 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:31:53.757174 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:31:53.757174 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:31:53.757174 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:31:53.757174 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1520a14-618c-4e2d-b20d-a08ebd9f6daa could not be found. Jun 22 10:31:53.757174 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:31:53.757174 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:31:53.757174 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:31:53.757174 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:31:53.757174 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:31:53.757174 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:31:53.757174 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:31:53.757174 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:31:53.757174 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1520a14-618c-4e2d-b20d-a08ebd9f6daa could not be found. Jun 22 10:31:53.757174 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:31:53.759619 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-4adf563b-5e9f-45c2-9385-c47cdcb3a6a2 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Returning 404 to user: Instance a1520a14-618c-4e2d-b20d-a08ebd9f6daa could not be found. {{(pid=117680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:31:53.759619 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-4adf563b-5e9f-45c2-9385-c47cdcb3a6a2 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa" status: 404 len: 111 microversion: 2.1 time: 0.195181 Jun 22 10:31:53.759619 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 473/926] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:31:53 2022] GET /compute/v2.1/servers/a1520a14-618c-4e2d-b20d-a08ebd9f6daa => generated 111 bytes in 200 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:31:54.924215 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-20d8033d-012e-4c4a-ab47-759caa065bdd tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:54.924871 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-20d8033d-012e-4c4a-ab47-759caa065bdd tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: da28df11-c078-43d5-81c4-e78ccf9f6504] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:54.932578 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-20d8033d-012e-4c4a-ab47-759caa065bdd tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:54.933028 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-20d8033d-012e-4c4a-ab47-759caa065bdd tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:54.933826 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-20d8033d-012e-4c4a-ab47-759caa065bdd tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:54.934257 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-20d8033d-012e-4c4a-ab47-759caa065bdd tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:54.950738 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.wsgi [None req-20d8033d-012e-4c4a-ab47-759caa065bdd tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] HTTP exception thrown: Instance da28df11-c078-43d5-81c4-e78ccf9f6504 could not be found. Jun 22 10:31:54.952568 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-20d8033d-012e-4c4a-ab47-759caa065bdd tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Request method failure captured: Jun 22 10:31:54.952568 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: request: DELETE /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504 HTTP/1.1 Jun 22 10:31:54.952568 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Accept: application/json Jun 22 10:31:54.952568 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Accept-Encoding: identity Jun 22 10:31:54.952568 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Connection: close Jun 22 10:31:54.952568 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Content-Length: 0 Jun 22 10:31:54.952568 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Content-Type: application/json Jun 22 10:31:54.952568 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Host: 10.222.0.66 Jun 22 10:31:54.952568 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Openstack-System-Scope: None Jun 22 10:31:54.952568 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: User-Agent: python-urllib3/1.26.9 Jun 22 10:31:54.952568 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Auth-Token: gAAAAABisu0BnE_6QJsexpU7NTJiv_Hqc8o3PmmQ7QZO72blyC_knl60ZrRuGijGZKHl9RR5uw4zHVvsp88mzHQfFz3yJPSm3wXa4GqXjc6Bzt_tqISAmWw_LHmOpybPJrtZUCxW67BMwQK-TIX_sxqI_elHLkYwKszKeVwHg9aHgSGQXB6cYVM Jun 22 10:31:54.952568 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Domain-Id: None Jun 22 10:31:54.952568 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Domain-Name: None Jun 22 10:31:54.952568 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Identity-Status: Confirmed Jun 22 10:31:54.952568 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Is-Admin-Project: True Jun 22 10:31:54.952568 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Domain-Id: default Jun 22 10:31:54.952568 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Domain-Name: Default Jun 22 10:31:54.952568 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Id: fecb66f4a7094cd3963caf460c52b88b Jun 22 10:31:54.952568 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Name: tempest-AttachVolumeTestJSON-986519348 Jun 22 10:31:54.952568 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Role: member,reader Jun 22 10:31:54.952568 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Roles: member,reader Jun 22 10:31:54.954952 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_fecb66f4a7094cd3963caf460c52b88b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/fecb66f4a7094cd3963caf460c52b88b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/fecb66f4a7094cd3963caf460c52b88b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/fecb66f4a7094cd3963caf460c52b88b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}] Jun 22 10:31:54.954952 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Tenant: tempest-AttachVolumeTestJSON-986519348 Jun 22 10:31:54.954952 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Tenant-Id: fecb66f4a7094cd3963caf460c52b88b Jun 22 10:31:54.954952 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Tenant-Name: tempest-AttachVolumeTestJSON-986519348 Jun 22 10:31:54.954952 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User: tempest-AttachVolumeTestJSON-986519348-project Jun 22 10:31:54.954952 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Domain-Id: default Jun 22 10:31:54.954952 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Domain-Name: Default Jun 22 10:31:54.954952 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Id: 595531abf958489795f2363026697a5b Jun 22 10:31:54.954952 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Name: tempest-AttachVolumeTestJSON-986519348-project Jun 22 10:31:54.954952 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: method: > Jun 22 10:31:54.954952 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: exception: Instance da28df11-c078-43d5-81c4-e78ccf9f6504 could not be found. Jun 22 10:31:54.954952 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: action_args: {'id': 'da28df11-c078-43d5-81c4-e78ccf9f6504'} Jun 22 10:31:54.956514 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:31:54.956514 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:31:54.956514 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:31:54.956514 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:31:54.956514 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:31:54.956514 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:31:54.956514 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:31:54.956514 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:31:54.956514 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:31:54.956514 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:31:54.956514 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da28df11-c078-43d5-81c4-e78ccf9f6504 could not be found. Jun 22 10:31:54.956514 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:31:54.956514 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:31:54.956514 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:31:54.956514 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:31:54.956514 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:31:54.956514 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:31:54.956514 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:31:54.956514 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:31:54.956514 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:31:54.959508 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:31:54.959508 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 10:31:54.959508 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 10:31:54.959508 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 10:31:54.959508 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 10:31:54.959508 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:31:54.959508 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:31:54.959508 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:31:54.959508 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:31:54.959508 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da28df11-c078-43d5-81c4-e78ccf9f6504 could not be found. Jun 22 10:31:54.959508 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:31:54.959508 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:31:54.959508 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:31:54.959508 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:31:54.959508 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:31:54.959508 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:31:54.959508 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:31:54.959508 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:31:54.959508 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da28df11-c078-43d5-81c4-e78ccf9f6504 could not be found. Jun 22 10:31:54.959508 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:31:54.962250 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-20d8033d-012e-4c4a-ab47-759caa065bdd tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Returning 404 to user: Instance da28df11-c078-43d5-81c4-e78ccf9f6504 could not be found. {{(pid=117679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:31:54.962250 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-20d8033d-012e-4c4a-ab47-759caa065bdd tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "DELETE /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504" status: 404 len: 111 microversion: 2.1 time: 0.033966 Jun 22 10:31:54.962250 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 454/927] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Jun 22 10:31:54 2022] DELETE /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:31:54.967189 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-d53c4af4-d8ff-40b8-8c29-eef09f7bee24 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:31:54.968197 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-d53c4af4-d8ff-40b8-8c29-eef09f7bee24 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] [instance: da28df11-c078-43d5-81c4-e78ccf9f6504] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:31:54.975733 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d53c4af4-d8ff-40b8-8c29-eef09f7bee24 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:54.976184 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d53c4af4-d8ff-40b8-8c29-eef09f7bee24 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:54.976977 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d53c4af4-d8ff-40b8-8c29-eef09f7bee24 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:31:54.977422 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d53c4af4-d8ff-40b8-8c29-eef09f7bee24 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:31:54.992609 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.wsgi [None req-d53c4af4-d8ff-40b8-8c29-eef09f7bee24 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] HTTP exception thrown: Instance da28df11-c078-43d5-81c4-e78ccf9f6504 could not be found. Jun 22 10:31:54.994190 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-d53c4af4-d8ff-40b8-8c29-eef09f7bee24 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Request method failure captured: Jun 22 10:31:54.994190 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: request: GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504 HTTP/1.1 Jun 22 10:31:54.994190 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Accept: application/json Jun 22 10:31:54.994190 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Accept-Encoding: identity Jun 22 10:31:54.994190 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Connection: close Jun 22 10:31:54.994190 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Content-Length: 0 Jun 22 10:31:54.994190 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Content-Type: application/json Jun 22 10:31:54.994190 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Host: 10.222.0.66 Jun 22 10:31:54.994190 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Openstack-System-Scope: None Jun 22 10:31:54.994190 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: User-Agent: python-urllib3/1.26.9 Jun 22 10:31:54.994190 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Auth-Token: gAAAAABisu0BnE_6QJsexpU7NTJiv_Hqc8o3PmmQ7QZO72blyC_knl60ZrRuGijGZKHl9RR5uw4zHVvsp88mzHQfFz3yJPSm3wXa4GqXjc6Bzt_tqISAmWw_LHmOpybPJrtZUCxW67BMwQK-TIX_sxqI_elHLkYwKszKeVwHg9aHgSGQXB6cYVM Jun 22 10:31:54.994190 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Domain-Id: None Jun 22 10:31:54.994190 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Domain-Name: None Jun 22 10:31:54.994190 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Identity-Status: Confirmed Jun 22 10:31:54.994190 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Is-Admin-Project: True Jun 22 10:31:54.994190 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Domain-Id: default Jun 22 10:31:54.994190 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Domain-Name: Default Jun 22 10:31:54.994190 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Id: fecb66f4a7094cd3963caf460c52b88b Jun 22 10:31:54.994190 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Name: tempest-AttachVolumeTestJSON-986519348 Jun 22 10:31:54.994190 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Role: member,reader Jun 22 10:31:54.994190 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Roles: member,reader Jun 22 10:31:54.996628 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_fecb66f4a7094cd3963caf460c52b88b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/fecb66f4a7094cd3963caf460c52b88b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/fecb66f4a7094cd3963caf460c52b88b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/fecb66f4a7094cd3963caf460c52b88b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}] Jun 22 10:31:54.996628 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant: tempest-AttachVolumeTestJSON-986519348 Jun 22 10:31:54.996628 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant-Id: fecb66f4a7094cd3963caf460c52b88b Jun 22 10:31:54.996628 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant-Name: tempest-AttachVolumeTestJSON-986519348 Jun 22 10:31:54.996628 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User: tempest-AttachVolumeTestJSON-986519348-project Jun 22 10:31:54.996628 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Domain-Id: default Jun 22 10:31:54.996628 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Domain-Name: Default Jun 22 10:31:54.996628 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Id: 595531abf958489795f2363026697a5b Jun 22 10:31:54.996628 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Name: tempest-AttachVolumeTestJSON-986519348-project Jun 22 10:31:54.996628 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: method: > Jun 22 10:31:54.996628 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: exception: Instance da28df11-c078-43d5-81c4-e78ccf9f6504 could not be found. Jun 22 10:31:54.996628 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: action_args: {'id': 'da28df11-c078-43d5-81c4-e78ccf9f6504'} Jun 22 10:31:54.997432 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:31:54.997432 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:31:54.997432 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:31:54.997432 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:31:54.997432 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:31:54.997432 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:31:54.997432 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:31:54.997432 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:31:54.997432 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:31:54.997432 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:31:54.997432 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da28df11-c078-43d5-81c4-e78ccf9f6504 could not be found. Jun 22 10:31:54.997432 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:31:54.997432 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:31:54.997432 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:31:54.997432 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:31:54.997432 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:31:54.997432 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:31:54.997432 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:31:54.997432 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:31:54.997432 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:31:54.998688 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:31:54.998688 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:31:54.998688 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:31:54.998688 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:31:54.998688 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:31:54.998688 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:31:54.998688 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:31:54.998688 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da28df11-c078-43d5-81c4-e78ccf9f6504 could not be found. Jun 22 10:31:54.998688 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:31:54.998688 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:31:54.998688 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:31:54.998688 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:31:54.998688 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:31:54.998688 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:31:54.998688 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:31:54.998688 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:31:54.998688 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da28df11-c078-43d5-81c4-e78ccf9f6504 could not be found. Jun 22 10:31:54.998688 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:31:55.000440 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-d53c4af4-d8ff-40b8-8c29-eef09f7bee24 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] Returning 404 to user: Instance da28df11-c078-43d5-81c4-e78ccf9f6504 could not be found. {{(pid=117680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:31:55.000440 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-d53c4af4-d8ff-40b8-8c29-eef09f7bee24 tempest-AttachVolumeTestJSON-986519348 tempest-AttachVolumeTestJSON-986519348-project] 10.222.0.66 "GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504" status: 404 len: 111 microversion: 2.1 time: 0.033241 Jun 22 10:31:55.000440 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 474/928] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:31:54 2022] GET /compute/v2.1/servers/da28df11-c078-43d5-81c4-e78ccf9f6504 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:32:29.480004 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-a70ee0d9-d1ca-4e71-b363-6099a7aa0a24 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:32:29.481057 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-a70ee0d9-d1ca-4e71-b363-6099a7aa0a24 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: 43019934-5ced-4af9-81e5-d0373842bee0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:32:29.483900 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:32:29.484695 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:32:29.492421 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a70ee0d9-d1ca-4e71-b363-6099a7aa0a24 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:29.492895 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a70ee0d9-d1ca-4e71-b363-6099a7aa0a24 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:29.493701 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a70ee0d9-d1ca-4e71-b363-6099a7aa0a24 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:29.494134 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a70ee0d9-d1ca-4e71-b363-6099a7aa0a24 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:29.522871 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-a70ee0d9-d1ca-4e71-b363-6099a7aa0a24 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/43019934-5ced-4af9-81e5-d0373842bee0/ips" status: 200 len: 149 microversion: 2.1 time: 0.048221 Jun 22 10:32:29.523466 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 455/929] 10.222.0.66 () {58 vars in 1247 bytes} [Wed Jun 22 10:32:29 2022] GET /compute/v2.1/servers/43019934-5ced-4af9-81e5-d0373842bee0/ips => generated 149 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:32:30.971907 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-25627890-538e-40ab-a8e7-80eeb70658b6 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3b6e15ad-31be-4adc-ac72-dfd61f1b755f"}} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:32:30.973032 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-25627890-538e-40ab-a8e7-80eeb70658b6 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: 43019934-5ced-4af9-81e5-d0373842bee0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:32:30.975497 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=1 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:32:30.976170 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:SELECT=38,nova_cell1:INSERT=1 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:32:30.982866 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-25627890-538e-40ab-a8e7-80eeb70658b6 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:30.983443 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-25627890-538e-40ab-a8e7-80eeb70658b6 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:30.984287 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-25627890-538e-40ab-a8e7-80eeb70658b6 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:30.984711 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-25627890-538e-40ab-a8e7-80eeb70658b6 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:31.281600 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-25627890-538e-40ab-a8e7-80eeb70658b6 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "POST /compute/v2.1/servers/43019934-5ced-4af9-81e5-d0373842bee0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.313787 Jun 22 10:32:31.282351 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 475/930] 10.222.0.66 () {60 vars in 1322 bytes} [Wed Jun 22 10:32:30 2022] POST /compute/v2.1/servers/43019934-5ced-4af9-81e5-d0373842bee0/os-volume_attachments => generated 194 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:32:39.112377 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-bf1e7f8f-6b3d-44eb-8f50-804e30c86d19 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:32:39.113100 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-bf1e7f8f-6b3d-44eb-8f50-804e30c86d19 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: 43019934-5ced-4af9-81e5-d0373842bee0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:32:39.119735 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-bf1e7f8f-6b3d-44eb-8f50-804e30c86d19 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:39.120186 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-bf1e7f8f-6b3d-44eb-8f50-804e30c86d19 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:39.121038 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-bf1e7f8f-6b3d-44eb-8f50-804e30c86d19 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:39.121487 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-bf1e7f8f-6b3d-44eb-8f50-804e30c86d19 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:39.245805 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.objects.instance [None req-bf1e7f8f-6b3d-44eb-8f50-804e30c86d19 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lazy-loading 'services' on Instance uuid 43019934-5ced-4af9-81e5-d0373842bee0 {{(pid=117679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:32:39.354937 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-bf1e7f8f-6b3d-44eb-8f50-804e30c86d19 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "DELETE /compute/v2.1/servers/43019934-5ced-4af9-81e5-d0373842bee0/os-volume_attachments/3b6e15ad-31be-4adc-ac72-dfd61f1b755f" status: 202 len: 0 microversion: 2.1 time: 0.246790 Jun 22 10:32:39.355712 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 456/931] 10.222.0.66 () {58 vars in 1415 bytes} [Wed Jun 22 10:32:39 2022] DELETE /compute/v2.1/servers/43019934-5ced-4af9-81e5-d0373842bee0/os-volume_attachments/3b6e15ad-31be-4adc-ac72-dfd61f1b755f => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:32:39.377477 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-47ce5680-61c6-42ff-b7fc-b39ccf19a84b tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:32:39.379590 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-47ce5680-61c6-42ff-b7fc-b39ccf19a84b tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: 43019934-5ced-4af9-81e5-d0373842bee0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:32:39.397460 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-47ce5680-61c6-42ff-b7fc-b39ccf19a84b tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:39.398574 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-47ce5680-61c6-42ff-b7fc-b39ccf19a84b tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:39.400529 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-47ce5680-61c6-42ff-b7fc-b39ccf19a84b tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:39.401328 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-47ce5680-61c6-42ff-b7fc-b39ccf19a84b tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:39.462912 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-47ce5680-61c6-42ff-b7fc-b39ccf19a84b tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/43019934-5ced-4af9-81e5-d0373842bee0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097573 Jun 22 10:32:39.464579 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 476/932] 10.222.0.66 () {58 vars in 1301 bytes} [Wed Jun 22 10:32:39 2022] GET /compute/v2.1/servers/43019934-5ced-4af9-81e5-d0373842bee0/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:32:40.481786 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-85872ae8-d8c2-4adf-9f0a-310dc3a4ccaf tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:32:40.483208 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-85872ae8-d8c2-4adf-9f0a-310dc3a4ccaf tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: 43019934-5ced-4af9-81e5-d0373842bee0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:32:40.491509 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-85872ae8-d8c2-4adf-9f0a-310dc3a4ccaf tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:40.491955 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-85872ae8-d8c2-4adf-9f0a-310dc3a4ccaf tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:40.492745 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-85872ae8-d8c2-4adf-9f0a-310dc3a4ccaf tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:40.493220 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-85872ae8-d8c2-4adf-9f0a-310dc3a4ccaf tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:40.526592 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-85872ae8-d8c2-4adf-9f0a-310dc3a4ccaf tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/43019934-5ced-4af9-81e5-d0373842bee0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051551 Jun 22 10:32:40.527168 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 457/933] 10.222.0.66 () {58 vars in 1301 bytes} [Wed Jun 22 10:32:40 2022] GET /compute/v2.1/servers/43019934-5ced-4af9-81e5-d0373842bee0/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 22 10:32:40.595009 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-ea013bea-857f-415e-a6d4-6f4273b38785 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:32:40.595854 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-ea013bea-857f-415e-a6d4-6f4273b38785 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: 43019934-5ced-4af9-81e5-d0373842bee0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:32:40.608132 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ea013bea-857f-415e-a6d4-6f4273b38785 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:40.608901 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ea013bea-857f-415e-a6d4-6f4273b38785 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:40.610425 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ea013bea-857f-415e-a6d4-6f4273b38785 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:40.611195 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ea013bea-857f-415e-a6d4-6f4273b38785 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:40.661004 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-ea013bea-857f-415e-a6d4-6f4273b38785 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: 43019934-5ced-4af9-81e5-d0373842bee0] Going to try to terminate instance {{(pid=117680) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 10:32:40.806123 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-ea013bea-857f-415e-a6d4-6f4273b38785 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "DELETE /compute/v2.1/servers/43019934-5ced-4af9-81e5-d0373842bee0" status: 204 len: 0 microversion: 2.1 time: 0.217095 Jun 22 10:32:40.807304 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 477/934] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Jun 22 10:32:40 2022] DELETE /compute/v2.1/servers/43019934-5ced-4af9-81e5-d0373842bee0 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 10:32:40.819142 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-8d4e242c-dd72-42e8-a15b-51a1c50d698f tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:32:40.820294 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-8d4e242c-dd72-42e8-a15b-51a1c50d698f tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: 43019934-5ced-4af9-81e5-d0373842bee0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:32:40.828805 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8d4e242c-dd72-42e8-a15b-51a1c50d698f tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:40.829321 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8d4e242c-dd72-42e8-a15b-51a1c50d698f tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:40.831049 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8d4e242c-dd72-42e8-a15b-51a1c50d698f tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:40.832039 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8d4e242c-dd72-42e8-a15b-51a1c50d698f tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:41.043707 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-8d4e242c-dd72-42e8-a15b-51a1c50d698f tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:32:41.054106 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-8d4e242c-dd72-42e8-a15b-51a1c50d698f tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/43019934-5ced-4af9-81e5-d0373842bee0" status: 200 len: 1680 microversion: 2.1 time: 0.240255 Jun 22 10:32:41.055083 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 458/935] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:32:40 2022] GET /compute/v2.1/servers/43019934-5ced-4af9-81e5-d0373842bee0 => generated 1680 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:32:42.076117 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-09aa33b0-7a5a-4f9f-abb0-9a4bb251858e tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:32:42.077667 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-09aa33b0-7a5a-4f9f-abb0-9a4bb251858e tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: 43019934-5ced-4af9-81e5-d0373842bee0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:32:42.086954 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-09aa33b0-7a5a-4f9f-abb0-9a4bb251858e tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:42.087559 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-09aa33b0-7a5a-4f9f-abb0-9a4bb251858e tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:42.089134 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-09aa33b0-7a5a-4f9f-abb0-9a4bb251858e tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:42.089683 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-09aa33b0-7a5a-4f9f-abb0-9a4bb251858e tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:42.265812 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-09aa33b0-7a5a-4f9f-abb0-9a4bb251858e tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:32:42.281242 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-09aa33b0-7a5a-4f9f-abb0-9a4bb251858e tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/43019934-5ced-4af9-81e5-d0373842bee0" status: 200 len: 1680 microversion: 2.1 time: 0.210350 Jun 22 10:32:42.282376 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 478/936] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:32:42 2022] GET /compute/v2.1/servers/43019934-5ced-4af9-81e5-d0373842bee0 => generated 1680 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:32:43.307417 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-9d2c89ef-8099-4cfc-817f-c600862c3350 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:32:43.309350 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-9d2c89ef-8099-4cfc-817f-c600862c3350 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: 43019934-5ced-4af9-81e5-d0373842bee0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:32:43.318729 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9d2c89ef-8099-4cfc-817f-c600862c3350 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:43.319673 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9d2c89ef-8099-4cfc-817f-c600862c3350 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:43.320936 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9d2c89ef-8099-4cfc-817f-c600862c3350 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:43.321669 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9d2c89ef-8099-4cfc-817f-c600862c3350 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:43.542490 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-9d2c89ef-8099-4cfc-817f-c600862c3350 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:32:43.552503 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-9d2c89ef-8099-4cfc-817f-c600862c3350 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/43019934-5ced-4af9-81e5-d0373842bee0" status: 200 len: 1680 microversion: 2.1 time: 0.250680 Jun 22 10:32:43.554154 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 459/937] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:32:43 2022] GET /compute/v2.1/servers/43019934-5ced-4af9-81e5-d0373842bee0 => generated 1680 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:32:44.413317 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-f5df74d3-50c4-4fa6-8b96-dd91133acf4c req-2e41a4af-9a00-4295-a9b0-f0071369c715 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43019934-5ced-4af9-81e5-d0373842bee0", "name": "network-vif-deleted", "tag": "0e25f1dd-b485-4c62-9076-a43bdc61b091"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:32:44.423068 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-f5df74d3-50c4-4fa6-8b96-dd91133acf4c req-2e41a4af-9a00-4295-a9b0-f0071369c715 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:44.423501 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-f5df74d3-50c4-4fa6-8b96-dd91133acf4c req-2e41a4af-9a00-4295-a9b0-f0071369c715 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:44.436513 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-f5df74d3-50c4-4fa6-8b96-dd91133acf4c req-2e41a4af-9a00-4295-a9b0-f0071369c715 service nova] Creating event network-vif-deleted:0e25f1dd-b485-4c62-9076-a43bdc61b091 for instance 43019934-5ced-4af9-81e5-d0373842bee0 on hv-cinder-84713 Jun 22 10:32:44.442076 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-f5df74d3-50c4-4fa6-8b96-dd91133acf4c req-2e41a4af-9a00-4295-a9b0-f0071369c715 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.425371 Jun 22 10:32:44.442737 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 479/938] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:32:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:32:44.581366 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-6d9c1c62-1805-4067-8ea3-98242fd43110 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:32:44.583689 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-6d9c1c62-1805-4067-8ea3-98242fd43110 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: 43019934-5ced-4af9-81e5-d0373842bee0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:32:44.605250 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6d9c1c62-1805-4067-8ea3-98242fd43110 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:44.606870 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6d9c1c62-1805-4067-8ea3-98242fd43110 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:44.608749 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6d9c1c62-1805-4067-8ea3-98242fd43110 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:44.609995 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6d9c1c62-1805-4067-8ea3-98242fd43110 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:44.689265 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6d9c1c62-1805-4067-8ea3-98242fd43110 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:44.690132 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6d9c1c62-1805-4067-8ea3-98242fd43110 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:44.691446 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.objects.instance [None req-6d9c1c62-1805-4067-8ea3-98242fd43110 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lazy-loading 'fault' on Instance uuid 43019934-5ced-4af9-81e5-d0373842bee0 {{(pid=117679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:32:44.764642 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-6d9c1c62-1805-4067-8ea3-98242fd43110 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da80b9a52feb462faf0469f2ab701fb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1db3fe97f51f47a98da3cbc8f0d55741', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:32:44.787049 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-6d9c1c62-1805-4067-8ea3-98242fd43110 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/43019934-5ced-4af9-81e5-d0373842bee0" status: 200 len: 1331 microversion: 2.1 time: 0.216217 Jun 22 10:32:44.789667 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 460/939] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:32:44 2022] GET /compute/v2.1/servers/43019934-5ced-4af9-81e5-d0373842bee0 => generated 1331 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:32:45.619655 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-45c58451-db6e-4411-9b05-1d555cf8b361 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:32:45.622309 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-45c58451-db6e-4411-9b05-1d555cf8b361 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:32:45.629473 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-45c58451-db6e-4411-9b05-1d555cf8b361 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:45.633323 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-45c58451-db6e-4411-9b05-1d555cf8b361 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:45.635364 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-45c58451-db6e-4411-9b05-1d555cf8b361 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:45.635917 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-45c58451-db6e-4411-9b05-1d555cf8b361 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:45.685745 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-45c58451-db6e-4411-9b05-1d555cf8b361 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.072049 Jun 22 10:32:45.686975 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 480/940] 10.222.0.66 () {60 vars in 1342 bytes} [Wed Jun 22 10:32:45 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0/os-volume_attachments => generated 25 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:32:45.759333 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-6b3d8fc6-68b1-43ec-a700-7f1c4917f7da tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:32:45.760199 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-6b3d8fc6-68b1-43ec-a700-7f1c4917f7da tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:32:45.771253 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6b3d8fc6-68b1-43ec-a700-7f1c4917f7da tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:45.771727 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6b3d8fc6-68b1-43ec-a700-7f1c4917f7da tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:45.772890 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6b3d8fc6-68b1-43ec-a700-7f1c4917f7da tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:45.773614 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6b3d8fc6-68b1-43ec-a700-7f1c4917f7da tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:45.808573 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-a648631a-0834-4d93-86fa-317ef360eab3 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:32:45.809149 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-a648631a-0834-4d93-86fa-317ef360eab3 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: 43019934-5ced-4af9-81e5-d0373842bee0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:32:45.815635 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-6b3d8fc6-68b1-43ec-a700-7f1c4917f7da tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Going to try to terminate instance {{(pid=117679) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 10:32:45.816789 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a648631a-0834-4d93-86fa-317ef360eab3 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:45.817228 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a648631a-0834-4d93-86fa-317ef360eab3 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:45.818017 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a648631a-0834-4d93-86fa-317ef360eab3 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:45.818455 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a648631a-0834-4d93-86fa-317ef360eab3 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:45.836503 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.wsgi [None req-a648631a-0834-4d93-86fa-317ef360eab3 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] HTTP exception thrown: Instance 43019934-5ced-4af9-81e5-d0373842bee0 could not be found. Jun 22 10:32:45.838607 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-a648631a-0834-4d93-86fa-317ef360eab3 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Request method failure captured: Jun 22 10:32:45.838607 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: request: GET /compute/v2.1/servers/43019934-5ced-4af9-81e5-d0373842bee0 HTTP/1.1 Jun 22 10:32:45.838607 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Accept: application/json Jun 22 10:32:45.838607 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Accept-Encoding: identity Jun 22 10:32:45.838607 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Connection: close Jun 22 10:32:45.838607 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Content-Length: 0 Jun 22 10:32:45.838607 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Content-Type: application/json Jun 22 10:32:45.838607 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Host: 10.222.0.66 Jun 22 10:32:45.838607 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Openstack-System-Scope: None Jun 22 10:32:45.838607 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: User-Agent: python-urllib3/1.26.9 Jun 22 10:32:45.838607 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Auth-Token: gAAAAABisu0Ck1QB2Lvyg9V3u3kBIuXEDJgkZ8XS4Rgzd5ukw0XPlYur1JC85E1WWEVd6k3S8eI6-t0Re7y4TmCuzTPaStOxInH_tNEfhxW9RG6_giYUrX4Dn5Ql7KnDFRmmntDTB2iztYRLelndnkJ5B_3DXuocSGsy72opKKw0vOKEx9YRw_Y Jun 22 10:32:45.838607 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Domain-Id: None Jun 22 10:32:45.838607 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Domain-Name: None Jun 22 10:32:45.838607 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Identity-Status: Confirmed Jun 22 10:32:45.838607 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Is-Admin-Project: True Jun 22 10:32:45.838607 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Domain-Id: default Jun 22 10:32:45.838607 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Domain-Name: Default Jun 22 10:32:45.838607 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Id: 1db3fe97f51f47a98da3cbc8f0d55741 Jun 22 10:32:45.838607 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Name: tempest-AttachVolumeNegativeTest-873283835 Jun 22 10:32:45.838607 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Role: member,reader Jun 22 10:32:45.838607 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Roles: member,reader Jun 22 10:32:45.841299 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_1db3fe97f51f47a98da3cbc8f0d55741"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1db3fe97f51f47a98da3cbc8f0d55741"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/1db3fe97f51f47a98da3cbc8f0d55741"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1db3fe97f51f47a98da3cbc8f0d55741"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}] Jun 22 10:32:45.841299 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant: tempest-AttachVolumeNegativeTest-873283835 Jun 22 10:32:45.841299 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant-Id: 1db3fe97f51f47a98da3cbc8f0d55741 Jun 22 10:32:45.841299 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-873283835 Jun 22 10:32:45.841299 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User: tempest-AttachVolumeNegativeTest-873283835-project Jun 22 10:32:45.841299 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Domain-Id: default Jun 22 10:32:45.841299 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Domain-Name: Default Jun 22 10:32:45.841299 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Id: da80b9a52feb462faf0469f2ab701fb8 Jun 22 10:32:45.841299 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Name: tempest-AttachVolumeNegativeTest-873283835-project Jun 22 10:32:45.841299 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: method: > Jun 22 10:32:45.841299 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: exception: Instance 43019934-5ced-4af9-81e5-d0373842bee0 could not be found. Jun 22 10:32:45.841299 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: action_args: {'id': '43019934-5ced-4af9-81e5-d0373842bee0'} Jun 22 10:32:45.842570 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:32:45.842570 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:32:45.842570 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:32:45.842570 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:32:45.842570 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:32:45.842570 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:32:45.842570 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:32:45.842570 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:32:45.842570 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:32:45.842570 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:32:45.842570 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43019934-5ced-4af9-81e5-d0373842bee0 could not be found. Jun 22 10:32:45.842570 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:32:45.842570 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:32:45.842570 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:32:45.842570 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:32:45.842570 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:32:45.842570 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:32:45.842570 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:32:45.842570 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:32:45.842570 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:32:45.844354 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:32:45.844354 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:32:45.844354 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:32:45.844354 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:32:45.844354 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:32:45.844354 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:32:45.844354 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:32:45.844354 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43019934-5ced-4af9-81e5-d0373842bee0 could not be found. Jun 22 10:32:45.844354 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:32:45.844354 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:32:45.844354 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:32:45.844354 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:32:45.844354 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:32:45.844354 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:32:45.844354 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:32:45.844354 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:32:45.844354 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43019934-5ced-4af9-81e5-d0373842bee0 could not be found. Jun 22 10:32:45.844354 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:32:45.846659 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-a648631a-0834-4d93-86fa-317ef360eab3 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Returning 404 to user: Instance 43019934-5ced-4af9-81e5-d0373842bee0 could not be found. {{(pid=117680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:32:45.846659 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-a648631a-0834-4d93-86fa-317ef360eab3 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/43019934-5ced-4af9-81e5-d0373842bee0" status: 404 len: 111 microversion: 2.1 time: 0.036144 Jun 22 10:32:45.846659 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 481/941] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:32:45 2022] GET /compute/v2.1/servers/43019934-5ced-4af9-81e5-d0373842bee0 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 22 10:32:45.849932 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-6dfbd666-5a4c-44fc-8c60-250ef5816b83 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '.version_select at 0x7f60d96cd280>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:32:45.877871 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-6dfbd666-5a4c-44fc-8c60-250ef5816b83 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1261141106" status: 202 len: 0 microversion: 2.1 time: 0.031628 Jun 22 10:32:45.878595 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 482/942] 10.222.0.66 () {58 vars in 1220 bytes} [Wed Jun 22 10:32:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1261141106 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:32:45.927795 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-6b3d8fc6-68b1-43ec-a700-7f1c4917f7da tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "DELETE /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 204 len: 0 microversion: 2.20 time: 0.175808 Jun 22 10:32:45.928663 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 461/943] 10.222.0.66 () {60 vars in 1279 bytes} [Wed Jun 22 10:32:45 2022] DELETE /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 22 10:32:45.940360 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-196c6c65-c6f2-4b06-b6e3-b385d93f65ac tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:32:45.941368 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-196c6c65-c6f2-4b06-b6e3-b385d93f65ac tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:32:45.951070 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-196c6c65-c6f2-4b06-b6e3-b385d93f65ac tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:45.951961 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-196c6c65-c6f2-4b06-b6e3-b385d93f65ac tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:45.952978 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-196c6c65-c6f2-4b06-b6e3-b385d93f65ac tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:45.953415 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-196c6c65-c6f2-4b06-b6e3-b385d93f65ac tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:46.149698 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-196c6c65-c6f2-4b06-b6e3-b385d93f65ac tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:32:46.183441 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-196c6c65-c6f2-4b06-b6e3-b385d93f65ac tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:32:46.190605 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-196c6c65-c6f2-4b06-b6e3-b385d93f65ac tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:32:46.194737 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-196c6c65-c6f2-4b06-b6e3-b385d93f65ac tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1723 microversion: 2.20 time: 0.259423 Jun 22 10:32:46.197145 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 483/944] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:32:45 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1723 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:32:47.228358 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-9f02a134-f949-41d3-9e47-e26b8da4e6b5 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:32:47.240349 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-9f02a134-f949-41d3-9e47-e26b8da4e6b5 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:32:47.258198 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9f02a134-f949-41d3-9e47-e26b8da4e6b5 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:47.259076 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9f02a134-f949-41d3-9e47-e26b8da4e6b5 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:47.260566 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9f02a134-f949-41d3-9e47-e26b8da4e6b5 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:47.261253 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9f02a134-f949-41d3-9e47-e26b8da4e6b5 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:47.480487 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-9f02a134-f949-41d3-9e47-e26b8da4e6b5 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:32:47.490699 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-9f02a134-f949-41d3-9e47-e26b8da4e6b5 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:32:47.492306 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-9f02a134-f949-41d3-9e47-e26b8da4e6b5 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:32:47.493544 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-9f02a134-f949-41d3-9e47-e26b8da4e6b5 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1723 microversion: 2.20 time: 0.273865 Jun 22 10:32:47.494463 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 462/945] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:32:47 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1723 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 22 10:32:48.033547 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-3e48ab61-45e0-42c9-8968-111e9180c260 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:32:48.034582 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-3e48ab61-45e0-42c9-8968-111e9180c260 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: 43019934-5ced-4af9-81e5-d0373842bee0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:32:48.046558 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3e48ab61-45e0-42c9-8968-111e9180c260 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:48.047700 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3e48ab61-45e0-42c9-8968-111e9180c260 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:48.049263 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3e48ab61-45e0-42c9-8968-111e9180c260 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:48.050117 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3e48ab61-45e0-42c9-8968-111e9180c260 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:48.081842 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.wsgi [None req-3e48ab61-45e0-42c9-8968-111e9180c260 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] HTTP exception thrown: Instance 43019934-5ced-4af9-81e5-d0373842bee0 could not be found. Jun 22 10:32:48.085312 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-3e48ab61-45e0-42c9-8968-111e9180c260 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Request method failure captured: Jun 22 10:32:48.085312 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: request: DELETE /compute/v2.1/servers/43019934-5ced-4af9-81e5-d0373842bee0 HTTP/1.1 Jun 22 10:32:48.085312 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Accept: application/json Jun 22 10:32:48.085312 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Accept-Encoding: identity Jun 22 10:32:48.085312 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Connection: close Jun 22 10:32:48.085312 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Content-Length: 0 Jun 22 10:32:48.085312 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Content-Type: application/json Jun 22 10:32:48.085312 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Host: 10.222.0.66 Jun 22 10:32:48.085312 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Openstack-System-Scope: None Jun 22 10:32:48.085312 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: User-Agent: python-urllib3/1.26.9 Jun 22 10:32:48.085312 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Auth-Token: gAAAAABisu0Ck1QB2Lvyg9V3u3kBIuXEDJgkZ8XS4Rgzd5ukw0XPlYur1JC85E1WWEVd6k3S8eI6-t0Re7y4TmCuzTPaStOxInH_tNEfhxW9RG6_giYUrX4Dn5Ql7KnDFRmmntDTB2iztYRLelndnkJ5B_3DXuocSGsy72opKKw0vOKEx9YRw_Y Jun 22 10:32:48.085312 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Domain-Id: None Jun 22 10:32:48.085312 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Domain-Name: None Jun 22 10:32:48.085312 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Identity-Status: Confirmed Jun 22 10:32:48.085312 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Is-Admin-Project: True Jun 22 10:32:48.085312 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Domain-Id: default Jun 22 10:32:48.085312 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Domain-Name: Default Jun 22 10:32:48.085312 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Id: 1db3fe97f51f47a98da3cbc8f0d55741 Jun 22 10:32:48.085312 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Name: tempest-AttachVolumeNegativeTest-873283835 Jun 22 10:32:48.085312 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Role: member,reader Jun 22 10:32:48.085312 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Roles: member,reader Jun 22 10:32:48.087997 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_1db3fe97f51f47a98da3cbc8f0d55741"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1db3fe97f51f47a98da3cbc8f0d55741"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/1db3fe97f51f47a98da3cbc8f0d55741"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1db3fe97f51f47a98da3cbc8f0d55741"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}] Jun 22 10:32:48.087997 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant: tempest-AttachVolumeNegativeTest-873283835 Jun 22 10:32:48.087997 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant-Id: 1db3fe97f51f47a98da3cbc8f0d55741 Jun 22 10:32:48.087997 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-873283835 Jun 22 10:32:48.087997 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User: tempest-AttachVolumeNegativeTest-873283835-project Jun 22 10:32:48.087997 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Domain-Id: default Jun 22 10:32:48.087997 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Domain-Name: Default Jun 22 10:32:48.087997 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Id: da80b9a52feb462faf0469f2ab701fb8 Jun 22 10:32:48.087997 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Name: tempest-AttachVolumeNegativeTest-873283835-project Jun 22 10:32:48.087997 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: method: > Jun 22 10:32:48.087997 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: exception: Instance 43019934-5ced-4af9-81e5-d0373842bee0 could not be found. Jun 22 10:32:48.087997 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: action_args: {'id': '43019934-5ced-4af9-81e5-d0373842bee0'} Jun 22 10:32:48.089296 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:32:48.089296 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:32:48.089296 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:32:48.089296 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:32:48.089296 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:32:48.089296 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:32:48.089296 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:32:48.089296 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:32:48.089296 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:32:48.089296 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:32:48.089296 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43019934-5ced-4af9-81e5-d0373842bee0 could not be found. Jun 22 10:32:48.089296 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:32:48.089296 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:32:48.089296 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:32:48.089296 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:32:48.089296 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:32:48.089296 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:32:48.089296 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:32:48.089296 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:32:48.089296 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:32:48.091538 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:32:48.091538 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 10:32:48.091538 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 10:32:48.091538 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 10:32:48.091538 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 10:32:48.091538 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:32:48.091538 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:32:48.091538 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:32:48.091538 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:32:48.091538 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43019934-5ced-4af9-81e5-d0373842bee0 could not be found. Jun 22 10:32:48.091538 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:32:48.091538 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:32:48.091538 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:32:48.091538 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:32:48.091538 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:32:48.091538 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:32:48.091538 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:32:48.091538 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:32:48.091538 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43019934-5ced-4af9-81e5-d0373842bee0 could not be found. Jun 22 10:32:48.091538 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:32:48.096065 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-3e48ab61-45e0-42c9-8968-111e9180c260 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Returning 404 to user: Instance 43019934-5ced-4af9-81e5-d0373842bee0 could not be found. {{(pid=117680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:32:48.097968 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-3e48ab61-45e0-42c9-8968-111e9180c260 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "DELETE /compute/v2.1/servers/43019934-5ced-4af9-81e5-d0373842bee0" status: 404 len: 111 microversion: 2.1 time: 0.071851 Jun 22 10:32:48.100687 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 484/946] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Jun 22 10:32:48 2022] DELETE /compute/v2.1/servers/43019934-5ced-4af9-81e5-d0373842bee0 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:32:48.111014 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-91c86619-4beb-4a19-b236-32e8a988d05e tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:32:48.111654 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-91c86619-4beb-4a19-b236-32e8a988d05e tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: 43019934-5ced-4af9-81e5-d0373842bee0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:32:48.123074 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-91c86619-4beb-4a19-b236-32e8a988d05e tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:48.124209 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-91c86619-4beb-4a19-b236-32e8a988d05e tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:48.125537 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-91c86619-4beb-4a19-b236-32e8a988d05e tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:48.125987 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-91c86619-4beb-4a19-b236-32e8a988d05e tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:48.145946 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.wsgi [None req-91c86619-4beb-4a19-b236-32e8a988d05e tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] HTTP exception thrown: Instance 43019934-5ced-4af9-81e5-d0373842bee0 could not be found. Jun 22 10:32:48.148101 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-91c86619-4beb-4a19-b236-32e8a988d05e tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Request method failure captured: Jun 22 10:32:48.148101 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: request: GET /compute/v2.1/servers/43019934-5ced-4af9-81e5-d0373842bee0 HTTP/1.1 Jun 22 10:32:48.148101 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Accept: application/json Jun 22 10:32:48.148101 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Accept-Encoding: identity Jun 22 10:32:48.148101 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Connection: close Jun 22 10:32:48.148101 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Content-Length: 0 Jun 22 10:32:48.148101 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Content-Type: application/json Jun 22 10:32:48.148101 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Host: 10.222.0.66 Jun 22 10:32:48.148101 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Openstack-System-Scope: None Jun 22 10:32:48.148101 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: User-Agent: python-urllib3/1.26.9 Jun 22 10:32:48.148101 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Auth-Token: gAAAAABisu0Ck1QB2Lvyg9V3u3kBIuXEDJgkZ8XS4Rgzd5ukw0XPlYur1JC85E1WWEVd6k3S8eI6-t0Re7y4TmCuzTPaStOxInH_tNEfhxW9RG6_giYUrX4Dn5Ql7KnDFRmmntDTB2iztYRLelndnkJ5B_3DXuocSGsy72opKKw0vOKEx9YRw_Y Jun 22 10:32:48.148101 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Domain-Id: None Jun 22 10:32:48.148101 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Domain-Name: None Jun 22 10:32:48.148101 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Identity-Status: Confirmed Jun 22 10:32:48.148101 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Is-Admin-Project: True Jun 22 10:32:48.148101 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Domain-Id: default Jun 22 10:32:48.148101 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Domain-Name: Default Jun 22 10:32:48.148101 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Id: 1db3fe97f51f47a98da3cbc8f0d55741 Jun 22 10:32:48.148101 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Name: tempest-AttachVolumeNegativeTest-873283835 Jun 22 10:32:48.148101 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Role: member,reader Jun 22 10:32:48.148101 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Roles: member,reader Jun 22 10:32:48.149868 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_1db3fe97f51f47a98da3cbc8f0d55741"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1db3fe97f51f47a98da3cbc8f0d55741"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/1db3fe97f51f47a98da3cbc8f0d55741"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1db3fe97f51f47a98da3cbc8f0d55741"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}] Jun 22 10:32:48.149868 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Tenant: tempest-AttachVolumeNegativeTest-873283835 Jun 22 10:32:48.149868 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Tenant-Id: 1db3fe97f51f47a98da3cbc8f0d55741 Jun 22 10:32:48.149868 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-873283835 Jun 22 10:32:48.149868 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User: tempest-AttachVolumeNegativeTest-873283835-project Jun 22 10:32:48.149868 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Domain-Id: default Jun 22 10:32:48.149868 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Domain-Name: Default Jun 22 10:32:48.149868 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Id: da80b9a52feb462faf0469f2ab701fb8 Jun 22 10:32:48.149868 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Name: tempest-AttachVolumeNegativeTest-873283835-project Jun 22 10:32:48.149868 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: method: > Jun 22 10:32:48.149868 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: exception: Instance 43019934-5ced-4af9-81e5-d0373842bee0 could not be found. Jun 22 10:32:48.149868 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: action_args: {'id': '43019934-5ced-4af9-81e5-d0373842bee0'} Jun 22 10:32:48.150945 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:32:48.150945 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:32:48.150945 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:32:48.150945 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:32:48.150945 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:32:48.150945 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:32:48.150945 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:32:48.150945 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:32:48.150945 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:32:48.150945 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:32:48.150945 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43019934-5ced-4af9-81e5-d0373842bee0 could not be found. Jun 22 10:32:48.150945 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:32:48.150945 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:32:48.150945 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:32:48.150945 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:32:48.150945 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:32:48.150945 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:32:48.150945 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:32:48.150945 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:32:48.150945 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:32:48.152469 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:32:48.152469 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:32:48.152469 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:32:48.152469 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:32:48.152469 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:32:48.152469 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:32:48.152469 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:32:48.152469 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43019934-5ced-4af9-81e5-d0373842bee0 could not be found. Jun 22 10:32:48.152469 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:32:48.152469 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:32:48.152469 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:32:48.152469 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:32:48.152469 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:32:48.152469 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:32:48.152469 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:32:48.152469 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:32:48.152469 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43019934-5ced-4af9-81e5-d0373842bee0 could not be found. Jun 22 10:32:48.152469 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:32:48.155684 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-91c86619-4beb-4a19-b236-32e8a988d05e tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Returning 404 to user: Instance 43019934-5ced-4af9-81e5-d0373842bee0 could not be found. {{(pid=117679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:32:48.156815 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-91c86619-4beb-4a19-b236-32e8a988d05e tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/43019934-5ced-4af9-81e5-d0373842bee0" status: 404 len: 111 microversion: 2.1 time: 0.052001 Jun 22 10:32:48.161289 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 463/947] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:32:48 2022] GET /compute/v2.1/servers/43019934-5ced-4af9-81e5-d0373842bee0 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:32:48.523882 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-6cad3535-8dba-4919-a7d4-e397dbe8ad37 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:32:48.525201 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-6cad3535-8dba-4919-a7d4-e397dbe8ad37 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:32:48.575558 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6cad3535-8dba-4919-a7d4-e397dbe8ad37 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:48.576443 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6cad3535-8dba-4919-a7d4-e397dbe8ad37 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:48.577484 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6cad3535-8dba-4919-a7d4-e397dbe8ad37 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:48.578065 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6cad3535-8dba-4919-a7d4-e397dbe8ad37 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:49.031980 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-6cad3535-8dba-4919-a7d4-e397dbe8ad37 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:32:49.048856 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-6cad3535-8dba-4919-a7d4-e397dbe8ad37 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:32:49.053281 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-6cad3535-8dba-4919-a7d4-e397dbe8ad37 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:32:49.056118 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-6cad3535-8dba-4919-a7d4-e397dbe8ad37 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1723 microversion: 2.20 time: 0.547175 Jun 22 10:32:49.057138 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 485/948] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:32:48 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1723 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:32:49.470718 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-7639b280-70cf-421a-8977-d0aa9f10e8ab tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:32:49.471570 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-7639b280-70cf-421a-8977-d0aa9f10e8ab tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: d02a6b26-3c65-44a5-8c06-88f9e38f30c7] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:32:49.487857 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7639b280-70cf-421a-8977-d0aa9f10e8ab tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:49.488955 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7639b280-70cf-421a-8977-d0aa9f10e8ab tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:49.491160 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7639b280-70cf-421a-8977-d0aa9f10e8ab tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:49.492191 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7639b280-70cf-421a-8977-d0aa9f10e8ab tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:49.525608 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.wsgi [None req-7639b280-70cf-421a-8977-d0aa9f10e8ab tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] HTTP exception thrown: Instance d02a6b26-3c65-44a5-8c06-88f9e38f30c7 could not be found. Jun 22 10:32:49.529601 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-7639b280-70cf-421a-8977-d0aa9f10e8ab tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Request method failure captured: Jun 22 10:32:49.529601 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: request: DELETE /compute/v2.1/servers/d02a6b26-3c65-44a5-8c06-88f9e38f30c7 HTTP/1.1 Jun 22 10:32:49.529601 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Accept: application/json Jun 22 10:32:49.529601 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Accept-Encoding: identity Jun 22 10:32:49.529601 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Connection: close Jun 22 10:32:49.529601 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Content-Length: 0 Jun 22 10:32:49.529601 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Content-Type: application/json Jun 22 10:32:49.529601 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Host: 10.222.0.66 Jun 22 10:32:49.529601 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Openstack-System-Scope: None Jun 22 10:32:49.529601 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: User-Agent: python-urllib3/1.26.9 Jun 22 10:32:49.529601 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Auth-Token: gAAAAABisu0Ck1QB2Lvyg9V3u3kBIuXEDJgkZ8XS4Rgzd5ukw0XPlYur1JC85E1WWEVd6k3S8eI6-t0Re7y4TmCuzTPaStOxInH_tNEfhxW9RG6_giYUrX4Dn5Ql7KnDFRmmntDTB2iztYRLelndnkJ5B_3DXuocSGsy72opKKw0vOKEx9YRw_Y Jun 22 10:32:49.529601 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Domain-Id: None Jun 22 10:32:49.529601 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Domain-Name: None Jun 22 10:32:49.529601 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Identity-Status: Confirmed Jun 22 10:32:49.529601 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Is-Admin-Project: True Jun 22 10:32:49.529601 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Domain-Id: default Jun 22 10:32:49.529601 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Domain-Name: Default Jun 22 10:32:49.529601 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Id: 1db3fe97f51f47a98da3cbc8f0d55741 Jun 22 10:32:49.529601 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Name: tempest-AttachVolumeNegativeTest-873283835 Jun 22 10:32:49.529601 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Role: member,reader Jun 22 10:32:49.529601 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Roles: member,reader Jun 22 10:32:49.532990 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_1db3fe97f51f47a98da3cbc8f0d55741"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1db3fe97f51f47a98da3cbc8f0d55741"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/1db3fe97f51f47a98da3cbc8f0d55741"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1db3fe97f51f47a98da3cbc8f0d55741"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}] Jun 22 10:32:49.532990 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Tenant: tempest-AttachVolumeNegativeTest-873283835 Jun 22 10:32:49.532990 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Tenant-Id: 1db3fe97f51f47a98da3cbc8f0d55741 Jun 22 10:32:49.532990 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-873283835 Jun 22 10:32:49.532990 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User: tempest-AttachVolumeNegativeTest-873283835-project Jun 22 10:32:49.532990 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Domain-Id: default Jun 22 10:32:49.532990 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Domain-Name: Default Jun 22 10:32:49.532990 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Id: da80b9a52feb462faf0469f2ab701fb8 Jun 22 10:32:49.532990 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Name: tempest-AttachVolumeNegativeTest-873283835-project Jun 22 10:32:49.532990 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: method: > Jun 22 10:32:49.532990 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: exception: Instance d02a6b26-3c65-44a5-8c06-88f9e38f30c7 could not be found. Jun 22 10:32:49.532990 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: action_args: {'id': 'd02a6b26-3c65-44a5-8c06-88f9e38f30c7'} Jun 22 10:32:49.534888 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:32:49.534888 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:32:49.534888 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:32:49.534888 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:32:49.534888 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:32:49.534888 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:32:49.534888 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:32:49.534888 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:32:49.534888 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:32:49.534888 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:32:49.534888 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d02a6b26-3c65-44a5-8c06-88f9e38f30c7 could not be found. Jun 22 10:32:49.534888 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:32:49.534888 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:32:49.534888 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:32:49.534888 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:32:49.534888 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:32:49.534888 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:32:49.534888 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:32:49.534888 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:32:49.534888 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:32:49.537573 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:32:49.537573 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 10:32:49.537573 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 10:32:49.537573 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 10:32:49.537573 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 10:32:49.537573 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:32:49.537573 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:32:49.537573 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:32:49.537573 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:32:49.537573 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d02a6b26-3c65-44a5-8c06-88f9e38f30c7 could not be found. Jun 22 10:32:49.537573 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:32:49.537573 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:32:49.537573 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:32:49.537573 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:32:49.537573 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:32:49.537573 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:32:49.537573 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:32:49.537573 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:32:49.537573 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d02a6b26-3c65-44a5-8c06-88f9e38f30c7 could not be found. Jun 22 10:32:49.537573 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:32:49.542615 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-7639b280-70cf-421a-8977-d0aa9f10e8ab tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Returning 404 to user: Instance d02a6b26-3c65-44a5-8c06-88f9e38f30c7 could not be found. {{(pid=117679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:32:49.544439 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-7639b280-70cf-421a-8977-d0aa9f10e8ab tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "DELETE /compute/v2.1/servers/d02a6b26-3c65-44a5-8c06-88f9e38f30c7" status: 404 len: 111 microversion: 2.1 time: 0.081916 Jun 22 10:32:49.550140 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 464/949] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Jun 22 10:32:49 2022] DELETE /compute/v2.1/servers/d02a6b26-3c65-44a5-8c06-88f9e38f30c7 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:32:49.558761 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-5eafdfc5-65bf-4712-a80e-332f5e38fd90 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:32:49.559881 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-5eafdfc5-65bf-4712-a80e-332f5e38fd90 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: d02a6b26-3c65-44a5-8c06-88f9e38f30c7] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:32:49.576498 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5eafdfc5-65bf-4712-a80e-332f5e38fd90 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:49.577694 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5eafdfc5-65bf-4712-a80e-332f5e38fd90 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:49.580991 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5eafdfc5-65bf-4712-a80e-332f5e38fd90 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:49.582844 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5eafdfc5-65bf-4712-a80e-332f5e38fd90 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:49.617797 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.wsgi [None req-5eafdfc5-65bf-4712-a80e-332f5e38fd90 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] HTTP exception thrown: Instance d02a6b26-3c65-44a5-8c06-88f9e38f30c7 could not be found. Jun 22 10:32:49.620548 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-5eafdfc5-65bf-4712-a80e-332f5e38fd90 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Request method failure captured: Jun 22 10:32:49.620548 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: request: GET /compute/v2.1/servers/d02a6b26-3c65-44a5-8c06-88f9e38f30c7 HTTP/1.1 Jun 22 10:32:49.620548 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Accept: application/json Jun 22 10:32:49.620548 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Accept-Encoding: identity Jun 22 10:32:49.620548 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Connection: close Jun 22 10:32:49.620548 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Content-Length: 0 Jun 22 10:32:49.620548 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Content-Type: application/json Jun 22 10:32:49.620548 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Host: 10.222.0.66 Jun 22 10:32:49.620548 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Openstack-System-Scope: None Jun 22 10:32:49.620548 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: User-Agent: python-urllib3/1.26.9 Jun 22 10:32:49.620548 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Auth-Token: gAAAAABisu0Ck1QB2Lvyg9V3u3kBIuXEDJgkZ8XS4Rgzd5ukw0XPlYur1JC85E1WWEVd6k3S8eI6-t0Re7y4TmCuzTPaStOxInH_tNEfhxW9RG6_giYUrX4Dn5Ql7KnDFRmmntDTB2iztYRLelndnkJ5B_3DXuocSGsy72opKKw0vOKEx9YRw_Y Jun 22 10:32:49.620548 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Domain-Id: None Jun 22 10:32:49.620548 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Domain-Name: None Jun 22 10:32:49.620548 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Identity-Status: Confirmed Jun 22 10:32:49.620548 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Is-Admin-Project: True Jun 22 10:32:49.620548 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Domain-Id: default Jun 22 10:32:49.620548 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Domain-Name: Default Jun 22 10:32:49.620548 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Id: 1db3fe97f51f47a98da3cbc8f0d55741 Jun 22 10:32:49.620548 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Name: tempest-AttachVolumeNegativeTest-873283835 Jun 22 10:32:49.620548 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Role: member,reader Jun 22 10:32:49.620548 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Roles: member,reader Jun 22 10:32:49.623194 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_1db3fe97f51f47a98da3cbc8f0d55741"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1db3fe97f51f47a98da3cbc8f0d55741"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/1db3fe97f51f47a98da3cbc8f0d55741"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1db3fe97f51f47a98da3cbc8f0d55741"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}] Jun 22 10:32:49.623194 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant: tempest-AttachVolumeNegativeTest-873283835 Jun 22 10:32:49.623194 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant-Id: 1db3fe97f51f47a98da3cbc8f0d55741 Jun 22 10:32:49.623194 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-873283835 Jun 22 10:32:49.623194 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User: tempest-AttachVolumeNegativeTest-873283835-project Jun 22 10:32:49.623194 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Domain-Id: default Jun 22 10:32:49.623194 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Domain-Name: Default Jun 22 10:32:49.623194 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Id: da80b9a52feb462faf0469f2ab701fb8 Jun 22 10:32:49.623194 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Name: tempest-AttachVolumeNegativeTest-873283835-project Jun 22 10:32:49.623194 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: method: > Jun 22 10:32:49.623194 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: exception: Instance d02a6b26-3c65-44a5-8c06-88f9e38f30c7 could not be found. Jun 22 10:32:49.623194 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: action_args: {'id': 'd02a6b26-3c65-44a5-8c06-88f9e38f30c7'} Jun 22 10:32:49.624997 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:32:49.624997 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:32:49.624997 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:32:49.624997 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:32:49.624997 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:32:49.624997 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:32:49.624997 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:32:49.624997 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:32:49.624997 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:32:49.624997 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:32:49.624997 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d02a6b26-3c65-44a5-8c06-88f9e38f30c7 could not be found. Jun 22 10:32:49.624997 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:32:49.624997 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:32:49.624997 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:32:49.624997 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:32:49.624997 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:32:49.624997 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:32:49.624997 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:32:49.624997 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:32:49.624997 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:32:49.627206 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:32:49.627206 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:32:49.627206 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:32:49.627206 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:32:49.627206 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:32:49.627206 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:32:49.627206 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:32:49.627206 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d02a6b26-3c65-44a5-8c06-88f9e38f30c7 could not be found. Jun 22 10:32:49.627206 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:32:49.627206 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:32:49.627206 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:32:49.627206 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:32:49.627206 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:32:49.627206 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:32:49.627206 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:32:49.627206 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:32:49.627206 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d02a6b26-3c65-44a5-8c06-88f9e38f30c7 could not be found. Jun 22 10:32:49.627206 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:32:49.629134 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-5eafdfc5-65bf-4712-a80e-332f5e38fd90 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Returning 404 to user: Instance d02a6b26-3c65-44a5-8c06-88f9e38f30c7 could not be found. {{(pid=117680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:32:49.629134 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-5eafdfc5-65bf-4712-a80e-332f5e38fd90 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/d02a6b26-3c65-44a5-8c06-88f9e38f30c7" status: 404 len: 111 microversion: 2.1 time: 0.070113 Jun 22 10:32:49.629134 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 486/950] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:32:49 2022] GET /compute/v2.1/servers/d02a6b26-3c65-44a5-8c06-88f9e38f30c7 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 22 10:32:49.640248 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-f57f9e0b-3470-450d-9c7a-20bde9c8f55f tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:32:49.641986 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-f57f9e0b-3470-450d-9c7a-20bde9c8f55f tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: 752de513-d1ba-43b2-b68d-912134b1d215] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:32:49.665074 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f57f9e0b-3470-450d-9c7a-20bde9c8f55f tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:49.666070 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f57f9e0b-3470-450d-9c7a-20bde9c8f55f tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:49.667670 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f57f9e0b-3470-450d-9c7a-20bde9c8f55f tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:49.669218 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f57f9e0b-3470-450d-9c7a-20bde9c8f55f tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:49.697478 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.wsgi [None req-f57f9e0b-3470-450d-9c7a-20bde9c8f55f tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] HTTP exception thrown: Instance 752de513-d1ba-43b2-b68d-912134b1d215 could not be found. Jun 22 10:32:49.701372 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-f57f9e0b-3470-450d-9c7a-20bde9c8f55f tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Request method failure captured: Jun 22 10:32:49.701372 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: request: DELETE /compute/v2.1/servers/752de513-d1ba-43b2-b68d-912134b1d215 HTTP/1.1 Jun 22 10:32:49.701372 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Accept: application/json Jun 22 10:32:49.701372 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Accept-Encoding: identity Jun 22 10:32:49.701372 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Connection: close Jun 22 10:32:49.701372 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Content-Length: 0 Jun 22 10:32:49.701372 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Content-Type: application/json Jun 22 10:32:49.701372 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Host: 10.222.0.66 Jun 22 10:32:49.701372 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Openstack-System-Scope: None Jun 22 10:32:49.701372 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: User-Agent: python-urllib3/1.26.9 Jun 22 10:32:49.701372 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Auth-Token: gAAAAABisu0Ck1QB2Lvyg9V3u3kBIuXEDJgkZ8XS4Rgzd5ukw0XPlYur1JC85E1WWEVd6k3S8eI6-t0Re7y4TmCuzTPaStOxInH_tNEfhxW9RG6_giYUrX4Dn5Ql7KnDFRmmntDTB2iztYRLelndnkJ5B_3DXuocSGsy72opKKw0vOKEx9YRw_Y Jun 22 10:32:49.701372 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Domain-Id: None Jun 22 10:32:49.701372 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Domain-Name: None Jun 22 10:32:49.701372 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Identity-Status: Confirmed Jun 22 10:32:49.701372 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Is-Admin-Project: True Jun 22 10:32:49.701372 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Domain-Id: default Jun 22 10:32:49.701372 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Domain-Name: Default Jun 22 10:32:49.701372 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Id: 1db3fe97f51f47a98da3cbc8f0d55741 Jun 22 10:32:49.701372 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Name: tempest-AttachVolumeNegativeTest-873283835 Jun 22 10:32:49.701372 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Role: member,reader Jun 22 10:32:49.701372 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Roles: member,reader Jun 22 10:32:49.704203 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_1db3fe97f51f47a98da3cbc8f0d55741"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1db3fe97f51f47a98da3cbc8f0d55741"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/1db3fe97f51f47a98da3cbc8f0d55741"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1db3fe97f51f47a98da3cbc8f0d55741"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}] Jun 22 10:32:49.704203 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Tenant: tempest-AttachVolumeNegativeTest-873283835 Jun 22 10:32:49.704203 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Tenant-Id: 1db3fe97f51f47a98da3cbc8f0d55741 Jun 22 10:32:49.704203 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-873283835 Jun 22 10:32:49.704203 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User: tempest-AttachVolumeNegativeTest-873283835-project Jun 22 10:32:49.704203 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Domain-Id: default Jun 22 10:32:49.704203 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Domain-Name: Default Jun 22 10:32:49.704203 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Id: da80b9a52feb462faf0469f2ab701fb8 Jun 22 10:32:49.704203 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Name: tempest-AttachVolumeNegativeTest-873283835-project Jun 22 10:32:49.704203 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: method: > Jun 22 10:32:49.704203 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: exception: Instance 752de513-d1ba-43b2-b68d-912134b1d215 could not be found. Jun 22 10:32:49.704203 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: action_args: {'id': '752de513-d1ba-43b2-b68d-912134b1d215'} Jun 22 10:32:49.705808 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:32:49.705808 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:32:49.705808 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:32:49.705808 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:32:49.705808 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:32:49.705808 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:32:49.705808 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:32:49.705808 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:32:49.705808 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:32:49.705808 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:32:49.705808 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 752de513-d1ba-43b2-b68d-912134b1d215 could not be found. Jun 22 10:32:49.705808 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:32:49.705808 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:32:49.705808 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:32:49.705808 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:32:49.705808 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:32:49.705808 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:32:49.705808 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:32:49.705808 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:32:49.705808 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:32:49.708499 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:32:49.708499 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 10:32:49.708499 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 10:32:49.708499 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 10:32:49.708499 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 10:32:49.708499 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:32:49.708499 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:32:49.708499 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:32:49.708499 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:32:49.708499 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 752de513-d1ba-43b2-b68d-912134b1d215 could not be found. Jun 22 10:32:49.708499 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:32:49.708499 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:32:49.708499 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:32:49.708499 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:32:49.708499 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:32:49.708499 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:32:49.708499 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:32:49.708499 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:32:49.708499 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 752de513-d1ba-43b2-b68d-912134b1d215 could not be found. Jun 22 10:32:49.708499 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:32:49.713213 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-f57f9e0b-3470-450d-9c7a-20bde9c8f55f tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Returning 404 to user: Instance 752de513-d1ba-43b2-b68d-912134b1d215 could not be found. {{(pid=117679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:32:49.715032 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-f57f9e0b-3470-450d-9c7a-20bde9c8f55f tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "DELETE /compute/v2.1/servers/752de513-d1ba-43b2-b68d-912134b1d215" status: 404 len: 111 microversion: 2.1 time: 0.082335 Jun 22 10:32:49.716314 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 465/951] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Jun 22 10:32:49 2022] DELETE /compute/v2.1/servers/752de513-d1ba-43b2-b68d-912134b1d215 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:32:49.731395 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-4defb65e-7988-4e8c-8e63-48b0cb56869c tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:32:49.732784 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-4defb65e-7988-4e8c-8e63-48b0cb56869c tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: 752de513-d1ba-43b2-b68d-912134b1d215] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:32:49.744624 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4defb65e-7988-4e8c-8e63-48b0cb56869c tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:49.745517 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4defb65e-7988-4e8c-8e63-48b0cb56869c tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:49.747087 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4defb65e-7988-4e8c-8e63-48b0cb56869c tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:49.747973 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4defb65e-7988-4e8c-8e63-48b0cb56869c tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:49.779140 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.wsgi [None req-4defb65e-7988-4e8c-8e63-48b0cb56869c tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] HTTP exception thrown: Instance 752de513-d1ba-43b2-b68d-912134b1d215 could not be found. Jun 22 10:32:49.783472 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-4defb65e-7988-4e8c-8e63-48b0cb56869c tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Request method failure captured: Jun 22 10:32:49.783472 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: request: GET /compute/v2.1/servers/752de513-d1ba-43b2-b68d-912134b1d215 HTTP/1.1 Jun 22 10:32:49.783472 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Accept: application/json Jun 22 10:32:49.783472 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Accept-Encoding: identity Jun 22 10:32:49.783472 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Connection: close Jun 22 10:32:49.783472 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Content-Length: 0 Jun 22 10:32:49.783472 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Content-Type: application/json Jun 22 10:32:49.783472 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Host: 10.222.0.66 Jun 22 10:32:49.783472 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Openstack-System-Scope: None Jun 22 10:32:49.783472 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: User-Agent: python-urllib3/1.26.9 Jun 22 10:32:49.783472 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Auth-Token: gAAAAABisu0Ck1QB2Lvyg9V3u3kBIuXEDJgkZ8XS4Rgzd5ukw0XPlYur1JC85E1WWEVd6k3S8eI6-t0Re7y4TmCuzTPaStOxInH_tNEfhxW9RG6_giYUrX4Dn5Ql7KnDFRmmntDTB2iztYRLelndnkJ5B_3DXuocSGsy72opKKw0vOKEx9YRw_Y Jun 22 10:32:49.783472 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Domain-Id: None Jun 22 10:32:49.783472 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Domain-Name: None Jun 22 10:32:49.783472 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Identity-Status: Confirmed Jun 22 10:32:49.783472 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Is-Admin-Project: True Jun 22 10:32:49.783472 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Domain-Id: default Jun 22 10:32:49.783472 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Domain-Name: Default Jun 22 10:32:49.783472 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Id: 1db3fe97f51f47a98da3cbc8f0d55741 Jun 22 10:32:49.783472 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Name: tempest-AttachVolumeNegativeTest-873283835 Jun 22 10:32:49.783472 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Role: member,reader Jun 22 10:32:49.783472 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Roles: member,reader Jun 22 10:32:49.786276 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_1db3fe97f51f47a98da3cbc8f0d55741"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1db3fe97f51f47a98da3cbc8f0d55741"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/1db3fe97f51f47a98da3cbc8f0d55741"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1db3fe97f51f47a98da3cbc8f0d55741"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}] Jun 22 10:32:49.786276 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant: tempest-AttachVolumeNegativeTest-873283835 Jun 22 10:32:49.786276 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant-Id: 1db3fe97f51f47a98da3cbc8f0d55741 Jun 22 10:32:49.786276 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-873283835 Jun 22 10:32:49.786276 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User: tempest-AttachVolumeNegativeTest-873283835-project Jun 22 10:32:49.786276 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Domain-Id: default Jun 22 10:32:49.786276 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Domain-Name: Default Jun 22 10:32:49.786276 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Id: da80b9a52feb462faf0469f2ab701fb8 Jun 22 10:32:49.786276 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Name: tempest-AttachVolumeNegativeTest-873283835-project Jun 22 10:32:49.786276 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: method: > Jun 22 10:32:49.786276 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: exception: Instance 752de513-d1ba-43b2-b68d-912134b1d215 could not be found. Jun 22 10:32:49.786276 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: action_args: {'id': '752de513-d1ba-43b2-b68d-912134b1d215'} Jun 22 10:32:49.787923 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:32:49.787923 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:32:49.787923 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:32:49.787923 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:32:49.787923 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:32:49.787923 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:32:49.787923 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:32:49.787923 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:32:49.787923 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:32:49.787923 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:32:49.787923 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 752de513-d1ba-43b2-b68d-912134b1d215 could not be found. Jun 22 10:32:49.787923 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:32:49.787923 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:32:49.787923 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:32:49.787923 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:32:49.787923 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:32:49.787923 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:32:49.787923 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:32:49.787923 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:32:49.787923 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:32:49.792670 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:32:49.792670 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:32:49.792670 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:32:49.792670 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:32:49.792670 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:32:49.792670 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:32:49.792670 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:32:49.792670 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 752de513-d1ba-43b2-b68d-912134b1d215 could not be found. Jun 22 10:32:49.792670 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:32:49.792670 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:32:49.792670 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:32:49.792670 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:32:49.792670 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:32:49.792670 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:32:49.792670 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:32:49.792670 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:32:49.792670 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 752de513-d1ba-43b2-b68d-912134b1d215 could not be found. Jun 22 10:32:49.792670 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:32:49.798419 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-4defb65e-7988-4e8c-8e63-48b0cb56869c tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Returning 404 to user: Instance 752de513-d1ba-43b2-b68d-912134b1d215 could not be found. {{(pid=117680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:32:49.798419 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-4defb65e-7988-4e8c-8e63-48b0cb56869c tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/752de513-d1ba-43b2-b68d-912134b1d215" status: 404 len: 111 microversion: 2.1 time: 0.074666 Jun 22 10:32:49.805971 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 487/952] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:32:49 2022] GET /compute/v2.1/servers/752de513-d1ba-43b2-b68d-912134b1d215 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:32:50.088336 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-7c69e36f-39e1-4a1a-aca9-42541f6ec87d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:32:50.089398 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-7c69e36f-39e1-4a1a-aca9-42541f6ec87d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:32:50.117913 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7c69e36f-39e1-4a1a-aca9-42541f6ec87d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:50.118693 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7c69e36f-39e1-4a1a-aca9-42541f6ec87d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:50.120008 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7c69e36f-39e1-4a1a-aca9-42541f6ec87d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:50.120825 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7c69e36f-39e1-4a1a-aca9-42541f6ec87d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:50.291703 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-7c69e36f-39e1-4a1a-aca9-42541f6ec87d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:32:50.306150 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-7c69e36f-39e1-4a1a-aca9-42541f6ec87d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:32:50.307769 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-7c69e36f-39e1-4a1a-aca9-42541f6ec87d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '60dbe36087e14f9e8bf885977b0e7426', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d4c799515b04fff924caa9819be4faf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:32:50.309027 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-7c69e36f-39e1-4a1a-aca9-42541f6ec87d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 200 len: 1655 microversion: 2.20 time: 0.228437 Jun 22 10:32:50.309838 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 466/953] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:32:50 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 1655 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 22 10:32:50.447220 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-646b84aa-94f9-4b2a-8f47-1fc139e33bd4 req-f3acaebb-162a-4d1e-b0fd-c99783fa7d79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d288ac1d-ffb9-4ac1-a5a4-095bf673cea0", "name": "network-vif-deleted", "tag": "41f6ee40-8d5d-4ffb-b909-afe6a1d8f347"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:32:50.463906 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-646b84aa-94f9-4b2a-8f47-1fc139e33bd4 req-f3acaebb-162a-4d1e-b0fd-c99783fa7d79 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:50.464624 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-646b84aa-94f9-4b2a-8f47-1fc139e33bd4 req-f3acaebb-162a-4d1e-b0fd-c99783fa7d79 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:50.488647 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-646b84aa-94f9-4b2a-8f47-1fc139e33bd4 req-f3acaebb-162a-4d1e-b0fd-c99783fa7d79 service nova] Creating event network-vif-deleted:41f6ee40-8d5d-4ffb-b909-afe6a1d8f347 for instance d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 on hv-cinder-84713 Jun 22 10:32:50.509431 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-646b84aa-94f9-4b2a-8f47-1fc139e33bd4 req-f3acaebb-162a-4d1e-b0fd-c99783fa7d79 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066350 Jun 22 10:32:50.510877 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 488/954] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:32:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:32:51.111982 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-6e629ab7-3f7b-495a-83dc-85f98519b038 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:32:51.114347 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-6e629ab7-3f7b-495a-83dc-85f98519b038 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: c9505087-b458-46dc-9fbb-ee4ef61decde] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:32:51.130121 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6e629ab7-3f7b-495a-83dc-85f98519b038 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:51.131557 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6e629ab7-3f7b-495a-83dc-85f98519b038 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:51.133871 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6e629ab7-3f7b-495a-83dc-85f98519b038 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:51.135112 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6e629ab7-3f7b-495a-83dc-85f98519b038 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:51.165824 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.wsgi [None req-6e629ab7-3f7b-495a-83dc-85f98519b038 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] HTTP exception thrown: Instance c9505087-b458-46dc-9fbb-ee4ef61decde could not be found. Jun 22 10:32:51.169471 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-6e629ab7-3f7b-495a-83dc-85f98519b038 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Request method failure captured: Jun 22 10:32:51.169471 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: request: DELETE /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde HTTP/1.1 Jun 22 10:32:51.169471 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Accept: application/json Jun 22 10:32:51.169471 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Accept-Encoding: identity Jun 22 10:32:51.169471 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Connection: close Jun 22 10:32:51.169471 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Content-Length: 0 Jun 22 10:32:51.169471 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Content-Type: application/json Jun 22 10:32:51.169471 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Host: 10.222.0.66 Jun 22 10:32:51.169471 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Openstack-System-Scope: None Jun 22 10:32:51.169471 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: User-Agent: python-urllib3/1.26.9 Jun 22 10:32:51.169471 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Auth-Token: gAAAAABisu0Ck1QB2Lvyg9V3u3kBIuXEDJgkZ8XS4Rgzd5ukw0XPlYur1JC85E1WWEVd6k3S8eI6-t0Re7y4TmCuzTPaStOxInH_tNEfhxW9RG6_giYUrX4Dn5Ql7KnDFRmmntDTB2iztYRLelndnkJ5B_3DXuocSGsy72opKKw0vOKEx9YRw_Y Jun 22 10:32:51.169471 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Domain-Id: None Jun 22 10:32:51.169471 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Domain-Name: None Jun 22 10:32:51.169471 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Identity-Status: Confirmed Jun 22 10:32:51.169471 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Is-Admin-Project: True Jun 22 10:32:51.169471 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Domain-Id: default Jun 22 10:32:51.169471 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Domain-Name: Default Jun 22 10:32:51.169471 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Id: 1db3fe97f51f47a98da3cbc8f0d55741 Jun 22 10:32:51.169471 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Name: tempest-AttachVolumeNegativeTest-873283835 Jun 22 10:32:51.169471 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Role: member,reader Jun 22 10:32:51.169471 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Roles: member,reader Jun 22 10:32:51.172237 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_1db3fe97f51f47a98da3cbc8f0d55741"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1db3fe97f51f47a98da3cbc8f0d55741"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/1db3fe97f51f47a98da3cbc8f0d55741"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1db3fe97f51f47a98da3cbc8f0d55741"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}] Jun 22 10:32:51.172237 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Tenant: tempest-AttachVolumeNegativeTest-873283835 Jun 22 10:32:51.172237 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Tenant-Id: 1db3fe97f51f47a98da3cbc8f0d55741 Jun 22 10:32:51.172237 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-873283835 Jun 22 10:32:51.172237 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User: tempest-AttachVolumeNegativeTest-873283835-project Jun 22 10:32:51.172237 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Domain-Id: default Jun 22 10:32:51.172237 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Domain-Name: Default Jun 22 10:32:51.172237 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Id: da80b9a52feb462faf0469f2ab701fb8 Jun 22 10:32:51.172237 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Name: tempest-AttachVolumeNegativeTest-873283835-project Jun 22 10:32:51.172237 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: method: > Jun 22 10:32:51.172237 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: exception: Instance c9505087-b458-46dc-9fbb-ee4ef61decde could not be found. Jun 22 10:32:51.172237 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: action_args: {'id': 'c9505087-b458-46dc-9fbb-ee4ef61decde'} Jun 22 10:32:51.173685 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:32:51.173685 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:32:51.173685 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:32:51.173685 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:32:51.173685 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:32:51.173685 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:32:51.173685 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:32:51.173685 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:32:51.173685 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:32:51.173685 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:32:51.173685 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9505087-b458-46dc-9fbb-ee4ef61decde could not be found. Jun 22 10:32:51.173685 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:32:51.173685 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:32:51.173685 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:32:51.173685 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:32:51.173685 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:32:51.173685 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:32:51.173685 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:32:51.173685 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:32:51.173685 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:32:51.176169 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:32:51.176169 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 10:32:51.176169 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 10:32:51.176169 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 10:32:51.176169 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 10:32:51.176169 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:32:51.176169 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:32:51.176169 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:32:51.176169 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:32:51.176169 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9505087-b458-46dc-9fbb-ee4ef61decde could not be found. Jun 22 10:32:51.176169 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:32:51.176169 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:32:51.176169 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:32:51.176169 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:32:51.176169 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:32:51.176169 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:32:51.176169 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:32:51.176169 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:32:51.176169 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9505087-b458-46dc-9fbb-ee4ef61decde could not be found. Jun 22 10:32:51.176169 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:32:51.182965 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-6e629ab7-3f7b-495a-83dc-85f98519b038 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Returning 404 to user: Instance c9505087-b458-46dc-9fbb-ee4ef61decde could not be found. {{(pid=117679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:32:51.183491 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-6e629ab7-3f7b-495a-83dc-85f98519b038 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "DELETE /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde" status: 404 len: 111 microversion: 2.1 time: 0.078786 Jun 22 10:32:51.189424 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 467/955] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Jun 22 10:32:51 2022] DELETE /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:32:51.200945 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-ae6393bf-5632-4bf6-8fd0-90abb2383615 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:32:51.203191 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-ae6393bf-5632-4bf6-8fd0-90abb2383615 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] [instance: c9505087-b458-46dc-9fbb-ee4ef61decde] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:32:51.218800 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ae6393bf-5632-4bf6-8fd0-90abb2383615 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:51.219959 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ae6393bf-5632-4bf6-8fd0-90abb2383615 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:51.221817 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ae6393bf-5632-4bf6-8fd0-90abb2383615 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:51.224136 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ae6393bf-5632-4bf6-8fd0-90abb2383615 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:51.257226 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.wsgi [None req-ae6393bf-5632-4bf6-8fd0-90abb2383615 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] HTTP exception thrown: Instance c9505087-b458-46dc-9fbb-ee4ef61decde could not be found. Jun 22 10:32:51.261129 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-ae6393bf-5632-4bf6-8fd0-90abb2383615 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Request method failure captured: Jun 22 10:32:51.261129 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: request: GET /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde HTTP/1.1 Jun 22 10:32:51.261129 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Accept: application/json Jun 22 10:32:51.261129 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Accept-Encoding: identity Jun 22 10:32:51.261129 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Connection: close Jun 22 10:32:51.261129 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Content-Length: 0 Jun 22 10:32:51.261129 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Content-Type: application/json Jun 22 10:32:51.261129 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Host: 10.222.0.66 Jun 22 10:32:51.261129 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Openstack-System-Scope: None Jun 22 10:32:51.261129 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: User-Agent: python-urllib3/1.26.9 Jun 22 10:32:51.261129 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Auth-Token: gAAAAABisu0Ck1QB2Lvyg9V3u3kBIuXEDJgkZ8XS4Rgzd5ukw0XPlYur1JC85E1WWEVd6k3S8eI6-t0Re7y4TmCuzTPaStOxInH_tNEfhxW9RG6_giYUrX4Dn5Ql7KnDFRmmntDTB2iztYRLelndnkJ5B_3DXuocSGsy72opKKw0vOKEx9YRw_Y Jun 22 10:32:51.261129 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Domain-Id: None Jun 22 10:32:51.261129 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Domain-Name: None Jun 22 10:32:51.261129 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Identity-Status: Confirmed Jun 22 10:32:51.261129 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Is-Admin-Project: True Jun 22 10:32:51.261129 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Domain-Id: default Jun 22 10:32:51.261129 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Domain-Name: Default Jun 22 10:32:51.261129 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Id: 1db3fe97f51f47a98da3cbc8f0d55741 Jun 22 10:32:51.261129 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Name: tempest-AttachVolumeNegativeTest-873283835 Jun 22 10:32:51.261129 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Role: member,reader Jun 22 10:32:51.261129 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Roles: member,reader Jun 22 10:32:51.263670 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_1db3fe97f51f47a98da3cbc8f0d55741"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1db3fe97f51f47a98da3cbc8f0d55741"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/1db3fe97f51f47a98da3cbc8f0d55741"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1db3fe97f51f47a98da3cbc8f0d55741"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}] Jun 22 10:32:51.263670 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant: tempest-AttachVolumeNegativeTest-873283835 Jun 22 10:32:51.263670 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant-Id: 1db3fe97f51f47a98da3cbc8f0d55741 Jun 22 10:32:51.263670 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-873283835 Jun 22 10:32:51.263670 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User: tempest-AttachVolumeNegativeTest-873283835-project Jun 22 10:32:51.263670 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Domain-Id: default Jun 22 10:32:51.263670 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Domain-Name: Default Jun 22 10:32:51.263670 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Id: da80b9a52feb462faf0469f2ab701fb8 Jun 22 10:32:51.263670 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Name: tempest-AttachVolumeNegativeTest-873283835-project Jun 22 10:32:51.263670 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: method: > Jun 22 10:32:51.263670 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: exception: Instance c9505087-b458-46dc-9fbb-ee4ef61decde could not be found. Jun 22 10:32:51.263670 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: action_args: {'id': 'c9505087-b458-46dc-9fbb-ee4ef61decde'} Jun 22 10:32:51.265209 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:32:51.265209 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:32:51.265209 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:32:51.265209 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:32:51.265209 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:32:51.265209 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:32:51.265209 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:32:51.265209 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:32:51.265209 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:32:51.265209 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:32:51.265209 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9505087-b458-46dc-9fbb-ee4ef61decde could not be found. Jun 22 10:32:51.265209 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:32:51.265209 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:32:51.265209 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:32:51.265209 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:32:51.265209 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:32:51.265209 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:32:51.265209 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:32:51.265209 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:32:51.265209 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:32:51.267648 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:32:51.267648 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:32:51.267648 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:32:51.267648 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:32:51.267648 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:32:51.267648 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:32:51.267648 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:32:51.267648 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9505087-b458-46dc-9fbb-ee4ef61decde could not be found. Jun 22 10:32:51.267648 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:32:51.267648 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:32:51.267648 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:32:51.267648 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:32:51.267648 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:32:51.267648 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:32:51.267648 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:32:51.267648 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:32:51.267648 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9505087-b458-46dc-9fbb-ee4ef61decde could not be found. Jun 22 10:32:51.267648 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:32:51.275724 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-ae6393bf-5632-4bf6-8fd0-90abb2383615 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] Returning 404 to user: Instance c9505087-b458-46dc-9fbb-ee4ef61decde could not be found. {{(pid=117680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:32:51.278136 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-ae6393bf-5632-4bf6-8fd0-90abb2383615 tempest-AttachVolumeNegativeTest-873283835 tempest-AttachVolumeNegativeTest-873283835-project] 10.222.0.66 "GET /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde" status: 404 len: 111 microversion: 2.1 time: 0.085120 Jun 22 10:32:51.285433 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 489/956] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:32:51 2022] GET /compute/v2.1/servers/c9505087-b458-46dc-9fbb-ee4ef61decde => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:32:51.346162 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-99d50f9d-6e1d-4510-91f9-f3dc68ade83e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:32:51.350028 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-99d50f9d-6e1d-4510-91f9-f3dc68ade83e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:32:51.381655 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-99d50f9d-6e1d-4510-91f9-f3dc68ade83e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:51.384118 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-99d50f9d-6e1d-4510-91f9-f3dc68ade83e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:51.391253 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-99d50f9d-6e1d-4510-91f9-f3dc68ade83e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:51.392091 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-99d50f9d-6e1d-4510-91f9-f3dc68ade83e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:51.438613 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.wsgi [None req-99d50f9d-6e1d-4510-91f9-f3dc68ade83e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] HTTP exception thrown: Instance d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 could not be found. Jun 22 10:32:51.444385 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-99d50f9d-6e1d-4510-91f9-f3dc68ade83e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Request method failure captured: Jun 22 10:32:51.444385 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: request: GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 HTTP/1.1 Jun 22 10:32:51.444385 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Accept: application/json Jun 22 10:32:51.444385 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Accept-Encoding: identity Jun 22 10:32:51.444385 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Connection: close Jun 22 10:32:51.444385 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Content-Length: 0 Jun 22 10:32:51.444385 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Content-Type: application/json Jun 22 10:32:51.444385 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Host: 10.222.0.66 Jun 22 10:32:51.444385 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Openstack-System-Scope: None Jun 22 10:32:51.444385 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: User-Agent: python-urllib3/1.26.9 Jun 22 10:32:51.444385 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Auth-Token: gAAAAABisuz90HkkEoUENfUChd6TmiQkAaIahUh0f1LcrVqF9X9TYzDu-_8w9AeJx8tQPD_-2wiFtyOESrqQJDGS8IsjYKcEcS029h6kHDvLm7osBnYwjRswPp4Qz-wy5Hc6lH8TPM_-J_go3iGsotRWd6UVGBE6G5HptHl0g9QD6RvYDslBJ8k Jun 22 10:32:51.444385 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Domain-Id: None Jun 22 10:32:51.444385 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Domain-Name: None Jun 22 10:32:51.444385 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Identity-Status: Confirmed Jun 22 10:32:51.444385 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Is-Admin-Project: True Jun 22 10:32:51.444385 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Openstack-Nova-Api-Version: 2.20 Jun 22 10:32:51.444385 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Domain-Id: default Jun 22 10:32:51.444385 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Domain-Name: Default Jun 22 10:32:51.444385 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Id: 5d4c799515b04fff924caa9819be4faf Jun 22 10:32:51.444385 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-414805869 Jun 22 10:32:51.444385 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Role: member,reader Jun 22 10:32:51.444385 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Roles: member,reader Jun 22 10:32:51.447391 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_5d4c799515b04fff924caa9819be4faf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5d4c799515b04fff924caa9819be4faf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/5d4c799515b04fff924caa9819be4faf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5d4c799515b04fff924caa9819be4faf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}] Jun 22 10:32:51.447391 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Tenant: tempest-AttachVolumeShelveTestJSON-414805869 Jun 22 10:32:51.447391 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Tenant-Id: 5d4c799515b04fff924caa9819be4faf Jun 22 10:32:51.447391 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-414805869 Jun 22 10:32:51.447391 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User: tempest-AttachVolumeShelveTestJSON-414805869-project Jun 22 10:32:51.447391 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Domain-Id: default Jun 22 10:32:51.447391 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Domain-Name: Default Jun 22 10:32:51.447391 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Id: 60dbe36087e14f9e8bf885977b0e7426 Jun 22 10:32:51.447391 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Name: tempest-AttachVolumeShelveTestJSON-414805869-project Jun 22 10:32:51.447391 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: method: > Jun 22 10:32:51.447391 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: exception: Instance d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 could not be found. Jun 22 10:32:51.447391 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: action_args: {'id': 'd288ac1d-ffb9-4ac1-a5a4-095bf673cea0'} Jun 22 10:32:51.449515 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:32:51.449515 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:32:51.449515 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:32:51.449515 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:32:51.449515 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:32:51.449515 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:32:51.449515 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:32:51.449515 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:32:51.449515 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:32:51.449515 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:32:51.449515 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 could not be found. Jun 22 10:32:51.449515 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:32:51.449515 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:32:51.449515 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:32:51.449515 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:32:51.449515 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:32:51.449515 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:32:51.449515 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:32:51.449515 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:32:51.449515 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:32:51.463942 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:32:51.463942 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:32:51.463942 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:32:51.463942 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:32:51.463942 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:32:51.463942 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:32:51.463942 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:32:51.463942 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 could not be found. Jun 22 10:32:51.463942 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:32:51.463942 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:32:51.463942 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:32:51.463942 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:32:51.463942 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:32:51.463942 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:32:51.463942 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:32:51.463942 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:32:51.463942 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 could not be found. Jun 22 10:32:51.463942 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:32:51.467672 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-99d50f9d-6e1d-4510-91f9-f3dc68ade83e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Returning 404 to user: Instance d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 could not be found. {{(pid=117679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:32:51.467672 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-99d50f9d-6e1d-4510-91f9-f3dc68ade83e tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 404 len: 111 microversion: 2.20 time: 0.121941 Jun 22 10:32:51.469085 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 468/957] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:32:51 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 22 10:32:51.472752 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-4021b83a-0a38-40d1-9438-b241fe2367fa tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '.version_select at 0x7f60d96eca60>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:32:51.511674 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-4021b83a-0a38-40d1-9438-b241fe2367fa tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1330518368" status: 204 len: 0 microversion: 2.20 time: 0.046662 Jun 22 10:32:51.517743 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 490/958] 10.222.0.66 () {60 vars in 1261 bytes} [Wed Jun 22 10:32:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1330518368 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 22 10:32:54.922290 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-e57cf325-0e1a-4972-8622-354aa41af065 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:32:54.923196 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-e57cf325-0e1a-4972-8622-354aa41af065 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:32:54.937286 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e57cf325-0e1a-4972-8622-354aa41af065 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:54.937920 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e57cf325-0e1a-4972-8622-354aa41af065 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:54.938771 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e57cf325-0e1a-4972-8622-354aa41af065 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:54.939222 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e57cf325-0e1a-4972-8622-354aa41af065 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:54.970742 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.wsgi [None req-e57cf325-0e1a-4972-8622-354aa41af065 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] HTTP exception thrown: Instance d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 could not be found. Jun 22 10:32:54.972413 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-e57cf325-0e1a-4972-8622-354aa41af065 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Request method failure captured: Jun 22 10:32:54.972413 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: request: DELETE /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 HTTP/1.1 Jun 22 10:32:54.972413 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Accept: application/json Jun 22 10:32:54.972413 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Accept-Encoding: identity Jun 22 10:32:54.972413 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Connection: close Jun 22 10:32:54.972413 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Content-Length: 0 Jun 22 10:32:54.972413 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Content-Type: application/json Jun 22 10:32:54.972413 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Host: 10.222.0.66 Jun 22 10:32:54.972413 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Openstack-System-Scope: None Jun 22 10:32:54.972413 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: User-Agent: python-urllib3/1.26.9 Jun 22 10:32:54.972413 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Auth-Token: gAAAAABisuz90HkkEoUENfUChd6TmiQkAaIahUh0f1LcrVqF9X9TYzDu-_8w9AeJx8tQPD_-2wiFtyOESrqQJDGS8IsjYKcEcS029h6kHDvLm7osBnYwjRswPp4Qz-wy5Hc6lH8TPM_-J_go3iGsotRWd6UVGBE6G5HptHl0g9QD6RvYDslBJ8k Jun 22 10:32:54.972413 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Domain-Id: None Jun 22 10:32:54.972413 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Domain-Name: None Jun 22 10:32:54.972413 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Identity-Status: Confirmed Jun 22 10:32:54.972413 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Is-Admin-Project: True Jun 22 10:32:54.972413 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Openstack-Nova-Api-Version: 2.20 Jun 22 10:32:54.972413 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Domain-Id: default Jun 22 10:32:54.972413 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Domain-Name: Default Jun 22 10:32:54.972413 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Id: 5d4c799515b04fff924caa9819be4faf Jun 22 10:32:54.972413 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-414805869 Jun 22 10:32:54.972413 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Role: member,reader Jun 22 10:32:54.972413 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Roles: member,reader Jun 22 10:32:54.975340 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_5d4c799515b04fff924caa9819be4faf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5d4c799515b04fff924caa9819be4faf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/5d4c799515b04fff924caa9819be4faf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5d4c799515b04fff924caa9819be4faf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}] Jun 22 10:32:54.975340 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Tenant: tempest-AttachVolumeShelveTestJSON-414805869 Jun 22 10:32:54.975340 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Tenant-Id: 5d4c799515b04fff924caa9819be4faf Jun 22 10:32:54.975340 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-414805869 Jun 22 10:32:54.975340 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User: tempest-AttachVolumeShelveTestJSON-414805869-project Jun 22 10:32:54.975340 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Domain-Id: default Jun 22 10:32:54.975340 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Domain-Name: Default Jun 22 10:32:54.975340 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Id: 60dbe36087e14f9e8bf885977b0e7426 Jun 22 10:32:54.975340 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Name: tempest-AttachVolumeShelveTestJSON-414805869-project Jun 22 10:32:54.975340 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: method: > Jun 22 10:32:54.975340 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: exception: Instance d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 could not be found. Jun 22 10:32:54.975340 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: action_args: {'id': 'd288ac1d-ffb9-4ac1-a5a4-095bf673cea0'} Jun 22 10:32:54.976875 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:32:54.976875 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:32:54.976875 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:32:54.976875 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:32:54.976875 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:32:54.976875 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:32:54.976875 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:32:54.976875 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:32:54.976875 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:32:54.976875 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:32:54.976875 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 could not be found. Jun 22 10:32:54.976875 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:32:54.976875 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:32:54.976875 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:32:54.976875 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:32:54.976875 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:32:54.976875 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:32:54.976875 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:32:54.976875 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:32:54.976875 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:32:54.979532 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:32:54.979532 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 10:32:54.979532 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 10:32:54.979532 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 10:32:54.979532 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 10:32:54.979532 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:32:54.979532 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:32:54.979532 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:32:54.979532 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:32:54.979532 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 could not be found. Jun 22 10:32:54.979532 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:32:54.979532 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:32:54.979532 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:32:54.979532 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:32:54.979532 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:32:54.979532 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:32:54.979532 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:32:54.979532 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:32:54.979532 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 could not be found. Jun 22 10:32:54.979532 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:32:54.982239 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-e57cf325-0e1a-4972-8622-354aa41af065 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Returning 404 to user: Instance d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 could not be found. {{(pid=117679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:32:54.982239 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-e57cf325-0e1a-4972-8622-354aa41af065 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "DELETE /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 404 len: 111 microversion: 2.20 time: 0.056984 Jun 22 10:32:54.984806 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-17c6737d-7f10-409a-99da-5eafbe08c19b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:32:54.984806 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-17c6737d-7f10-409a-99da-5eafbe08c19b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: d288ac1d-ffb9-4ac1-a5a4-095bf673cea0] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:32:55.001134 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 469/959] 10.222.0.66 () {60 vars in 1279 bytes} [Wed Jun 22 10:32:54 2022] DELETE /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 22 10:32:55.002564 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-17c6737d-7f10-409a-99da-5eafbe08c19b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:55.003026 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-17c6737d-7f10-409a-99da-5eafbe08c19b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:55.003877 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-17c6737d-7f10-409a-99da-5eafbe08c19b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:55.004322 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-17c6737d-7f10-409a-99da-5eafbe08c19b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:55.033683 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.wsgi [None req-17c6737d-7f10-409a-99da-5eafbe08c19b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] HTTP exception thrown: Instance d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 could not be found. Jun 22 10:32:55.035512 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-17c6737d-7f10-409a-99da-5eafbe08c19b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Request method failure captured: Jun 22 10:32:55.035512 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: request: GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 HTTP/1.1 Jun 22 10:32:55.035512 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Accept: application/json Jun 22 10:32:55.035512 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Accept-Encoding: identity Jun 22 10:32:55.035512 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Connection: close Jun 22 10:32:55.035512 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Content-Length: 0 Jun 22 10:32:55.035512 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Content-Type: application/json Jun 22 10:32:55.035512 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Host: 10.222.0.66 Jun 22 10:32:55.035512 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Openstack-System-Scope: None Jun 22 10:32:55.035512 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: User-Agent: python-urllib3/1.26.9 Jun 22 10:32:55.035512 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Auth-Token: gAAAAABisuz90HkkEoUENfUChd6TmiQkAaIahUh0f1LcrVqF9X9TYzDu-_8w9AeJx8tQPD_-2wiFtyOESrqQJDGS8IsjYKcEcS029h6kHDvLm7osBnYwjRswPp4Qz-wy5Hc6lH8TPM_-J_go3iGsotRWd6UVGBE6G5HptHl0g9QD6RvYDslBJ8k Jun 22 10:32:55.035512 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Domain-Id: None Jun 22 10:32:55.035512 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Domain-Name: None Jun 22 10:32:55.035512 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Identity-Status: Confirmed Jun 22 10:32:55.035512 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Is-Admin-Project: True Jun 22 10:32:55.035512 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Openstack-Nova-Api-Version: 2.20 Jun 22 10:32:55.035512 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Domain-Id: default Jun 22 10:32:55.035512 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Domain-Name: Default Jun 22 10:32:55.035512 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Id: 5d4c799515b04fff924caa9819be4faf Jun 22 10:32:55.035512 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-414805869 Jun 22 10:32:55.035512 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Role: member,reader Jun 22 10:32:55.035512 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Roles: member,reader Jun 22 10:32:55.038416 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_5d4c799515b04fff924caa9819be4faf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5d4c799515b04fff924caa9819be4faf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/5d4c799515b04fff924caa9819be4faf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5d4c799515b04fff924caa9819be4faf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}] Jun 22 10:32:55.038416 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant: tempest-AttachVolumeShelveTestJSON-414805869 Jun 22 10:32:55.038416 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant-Id: 5d4c799515b04fff924caa9819be4faf Jun 22 10:32:55.038416 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-414805869 Jun 22 10:32:55.038416 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User: tempest-AttachVolumeShelveTestJSON-414805869-project Jun 22 10:32:55.038416 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Domain-Id: default Jun 22 10:32:55.038416 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Domain-Name: Default Jun 22 10:32:55.038416 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Id: 60dbe36087e14f9e8bf885977b0e7426 Jun 22 10:32:55.038416 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Name: tempest-AttachVolumeShelveTestJSON-414805869-project Jun 22 10:32:55.038416 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: method: > Jun 22 10:32:55.038416 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: exception: Instance d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 could not be found. Jun 22 10:32:55.038416 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: action_args: {'id': 'd288ac1d-ffb9-4ac1-a5a4-095bf673cea0'} Jun 22 10:32:55.039993 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:32:55.039993 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:32:55.039993 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:32:55.039993 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:32:55.039993 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:32:55.039993 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:32:55.039993 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:32:55.039993 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:32:55.039993 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:32:55.039993 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:32:55.039993 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 could not be found. Jun 22 10:32:55.039993 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:32:55.039993 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:32:55.039993 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:32:55.039993 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:32:55.039993 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:32:55.039993 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:32:55.039993 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:32:55.039993 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:32:55.039993 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:32:55.043179 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:32:55.043179 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:32:55.043179 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:32:55.043179 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:32:55.043179 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:32:55.043179 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:32:55.043179 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:32:55.043179 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 could not be found. Jun 22 10:32:55.043179 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:32:55.043179 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:32:55.043179 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:32:55.043179 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:32:55.043179 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:32:55.043179 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:32:55.043179 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:32:55.043179 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:32:55.043179 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 could not be found. Jun 22 10:32:55.043179 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:32:55.045518 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-17c6737d-7f10-409a-99da-5eafbe08c19b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Returning 404 to user: Instance d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 could not be found. {{(pid=117680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:32:55.045518 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-17c6737d-7f10-409a-99da-5eafbe08c19b tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0" status: 404 len: 111 microversion: 2.20 time: 0.065807 Jun 22 10:32:55.045518 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 491/960] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:32:54 2022] GET /compute/v2.1/servers/d288ac1d-ffb9-4ac1-a5a4-095bf673cea0 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 22 10:32:56.427283 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-fb99af0a-c45e-406e-b250-cc48567b38c1 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:32:56.432252 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-fb99af0a-c45e-406e-b250-cc48567b38c1 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:32:56.449624 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-fb99af0a-c45e-406e-b250-cc48567b38c1 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:56.451816 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-fb99af0a-c45e-406e-b250-cc48567b38c1 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:56.453627 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-fb99af0a-c45e-406e-b250-cc48567b38c1 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:56.454772 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-fb99af0a-c45e-406e-b250-cc48567b38c1 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:56.505660 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.wsgi [None req-fb99af0a-c45e-406e-b250-cc48567b38c1 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] HTTP exception thrown: Instance 755c0b10-e04a-42fa-86da-8cc65537315d could not be found. Jun 22 10:32:56.507343 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-fb99af0a-c45e-406e-b250-cc48567b38c1 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Request method failure captured: Jun 22 10:32:56.507343 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: request: DELETE /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d HTTP/1.1 Jun 22 10:32:56.507343 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Accept: application/json Jun 22 10:32:56.507343 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Accept-Encoding: identity Jun 22 10:32:56.507343 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Connection: close Jun 22 10:32:56.507343 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Content-Length: 0 Jun 22 10:32:56.507343 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Content-Type: application/json Jun 22 10:32:56.507343 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Host: 10.222.0.66 Jun 22 10:32:56.507343 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Openstack-System-Scope: None Jun 22 10:32:56.507343 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: User-Agent: python-urllib3/1.26.9 Jun 22 10:32:56.507343 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Auth-Token: gAAAAABisuz90HkkEoUENfUChd6TmiQkAaIahUh0f1LcrVqF9X9TYzDu-_8w9AeJx8tQPD_-2wiFtyOESrqQJDGS8IsjYKcEcS029h6kHDvLm7osBnYwjRswPp4Qz-wy5Hc6lH8TPM_-J_go3iGsotRWd6UVGBE6G5HptHl0g9QD6RvYDslBJ8k Jun 22 10:32:56.507343 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Domain-Id: None Jun 22 10:32:56.507343 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Domain-Name: None Jun 22 10:32:56.507343 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Identity-Status: Confirmed Jun 22 10:32:56.507343 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Is-Admin-Project: True Jun 22 10:32:56.507343 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Openstack-Nova-Api-Version: 2.20 Jun 22 10:32:56.507343 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Domain-Id: default Jun 22 10:32:56.507343 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Domain-Name: Default Jun 22 10:32:56.507343 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Id: 5d4c799515b04fff924caa9819be4faf Jun 22 10:32:56.507343 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-414805869 Jun 22 10:32:56.507343 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Role: member,reader Jun 22 10:32:56.507343 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Roles: member,reader Jun 22 10:32:56.508986 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_5d4c799515b04fff924caa9819be4faf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5d4c799515b04fff924caa9819be4faf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/5d4c799515b04fff924caa9819be4faf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5d4c799515b04fff924caa9819be4faf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}] Jun 22 10:32:56.508986 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Tenant: tempest-AttachVolumeShelveTestJSON-414805869 Jun 22 10:32:56.508986 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Tenant-Id: 5d4c799515b04fff924caa9819be4faf Jun 22 10:32:56.508986 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-414805869 Jun 22 10:32:56.508986 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User: tempest-AttachVolumeShelveTestJSON-414805869-project Jun 22 10:32:56.508986 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Domain-Id: default Jun 22 10:32:56.508986 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Domain-Name: Default Jun 22 10:32:56.508986 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Id: 60dbe36087e14f9e8bf885977b0e7426 Jun 22 10:32:56.508986 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Name: tempest-AttachVolumeShelveTestJSON-414805869-project Jun 22 10:32:56.508986 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: method: > Jun 22 10:32:56.508986 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: exception: Instance 755c0b10-e04a-42fa-86da-8cc65537315d could not be found. Jun 22 10:32:56.508986 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: action_args: {'id': '755c0b10-e04a-42fa-86da-8cc65537315d'} Jun 22 10:32:56.509742 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:32:56.509742 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:32:56.509742 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:32:56.509742 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:32:56.509742 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:32:56.509742 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:32:56.509742 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:32:56.509742 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:32:56.509742 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:32:56.509742 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:32:56.509742 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 755c0b10-e04a-42fa-86da-8cc65537315d could not be found. Jun 22 10:32:56.509742 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:32:56.509742 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:32:56.509742 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:32:56.509742 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:32:56.509742 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:32:56.509742 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:32:56.509742 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:32:56.509742 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:32:56.509742 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:32:56.511936 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:32:56.511936 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 10:32:56.511936 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 10:32:56.511936 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 10:32:56.511936 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 10:32:56.511936 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:32:56.511936 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:32:56.511936 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:32:56.511936 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:32:56.511936 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 755c0b10-e04a-42fa-86da-8cc65537315d could not be found. Jun 22 10:32:56.511936 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:32:56.511936 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:32:56.511936 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:32:56.511936 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:32:56.511936 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:32:56.511936 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:32:56.511936 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:32:56.511936 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:32:56.511936 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 755c0b10-e04a-42fa-86da-8cc65537315d could not be found. Jun 22 10:32:56.511936 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:32:56.515659 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-fb99af0a-c45e-406e-b250-cc48567b38c1 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Returning 404 to user: Instance 755c0b10-e04a-42fa-86da-8cc65537315d could not be found. {{(pid=117679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:32:56.516915 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-fb99af0a-c45e-406e-b250-cc48567b38c1 tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "DELETE /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 404 len: 111 microversion: 2.20 time: 0.103646 Jun 22 10:32:56.527457 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-d98a746b-97fc-4ce5-8bec-e4126167841d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:32:56.529644 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-d98a746b-97fc-4ce5-8bec-e4126167841d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] [instance: 755c0b10-e04a-42fa-86da-8cc65537315d] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:32:56.530921 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 470/961] 10.222.0.66 () {60 vars in 1279 bytes} [Wed Jun 22 10:32:56 2022] DELETE /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 22 10:32:56.538755 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d98a746b-97fc-4ce5-8bec-e4126167841d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:56.540119 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d98a746b-97fc-4ce5-8bec-e4126167841d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:56.540909 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d98a746b-97fc-4ce5-8bec-e4126167841d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:32:56.541473 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d98a746b-97fc-4ce5-8bec-e4126167841d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:32:56.561749 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.wsgi [None req-d98a746b-97fc-4ce5-8bec-e4126167841d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] HTTP exception thrown: Instance 755c0b10-e04a-42fa-86da-8cc65537315d could not be found. Jun 22 10:32:56.566041 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-d98a746b-97fc-4ce5-8bec-e4126167841d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Request method failure captured: Jun 22 10:32:56.566041 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: request: GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d HTTP/1.1 Jun 22 10:32:56.566041 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Accept: application/json Jun 22 10:32:56.566041 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Accept-Encoding: identity Jun 22 10:32:56.566041 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Connection: close Jun 22 10:32:56.566041 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Content-Length: 0 Jun 22 10:32:56.566041 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Content-Type: application/json Jun 22 10:32:56.566041 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Host: 10.222.0.66 Jun 22 10:32:56.566041 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Openstack-System-Scope: None Jun 22 10:32:56.566041 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: User-Agent: python-urllib3/1.26.9 Jun 22 10:32:56.566041 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Auth-Token: gAAAAABisuz90HkkEoUENfUChd6TmiQkAaIahUh0f1LcrVqF9X9TYzDu-_8w9AeJx8tQPD_-2wiFtyOESrqQJDGS8IsjYKcEcS029h6kHDvLm7osBnYwjRswPp4Qz-wy5Hc6lH8TPM_-J_go3iGsotRWd6UVGBE6G5HptHl0g9QD6RvYDslBJ8k Jun 22 10:32:56.566041 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Domain-Id: None Jun 22 10:32:56.566041 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Domain-Name: None Jun 22 10:32:56.566041 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Identity-Status: Confirmed Jun 22 10:32:56.566041 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Is-Admin-Project: True Jun 22 10:32:56.566041 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Openstack-Nova-Api-Version: 2.20 Jun 22 10:32:56.566041 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Domain-Id: default Jun 22 10:32:56.566041 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Domain-Name: Default Jun 22 10:32:56.566041 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Id: 5d4c799515b04fff924caa9819be4faf Jun 22 10:32:56.566041 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-414805869 Jun 22 10:32:56.566041 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Role: member,reader Jun 22 10:32:56.566041 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Roles: member,reader Jun 22 10:32:56.568134 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_5d4c799515b04fff924caa9819be4faf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5d4c799515b04fff924caa9819be4faf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/5d4c799515b04fff924caa9819be4faf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5d4c799515b04fff924caa9819be4faf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}] Jun 22 10:32:56.568134 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant: tempest-AttachVolumeShelveTestJSON-414805869 Jun 22 10:32:56.568134 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant-Id: 5d4c799515b04fff924caa9819be4faf Jun 22 10:32:56.568134 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-414805869 Jun 22 10:32:56.568134 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User: tempest-AttachVolumeShelveTestJSON-414805869-project Jun 22 10:32:56.568134 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Domain-Id: default Jun 22 10:32:56.568134 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Domain-Name: Default Jun 22 10:32:56.568134 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Id: 60dbe36087e14f9e8bf885977b0e7426 Jun 22 10:32:56.568134 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Name: tempest-AttachVolumeShelveTestJSON-414805869-project Jun 22 10:32:56.568134 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: method: > Jun 22 10:32:56.568134 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: exception: Instance 755c0b10-e04a-42fa-86da-8cc65537315d could not be found. Jun 22 10:32:56.568134 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: action_args: {'id': '755c0b10-e04a-42fa-86da-8cc65537315d'} Jun 22 10:32:56.569825 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:32:56.569825 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:32:56.569825 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:32:56.569825 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:32:56.569825 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:32:56.569825 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:32:56.569825 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:32:56.569825 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:32:56.569825 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:32:56.569825 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:32:56.569825 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 755c0b10-e04a-42fa-86da-8cc65537315d could not be found. Jun 22 10:32:56.569825 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:32:56.569825 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:32:56.569825 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:32:56.569825 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:32:56.569825 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:32:56.569825 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:32:56.569825 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:32:56.569825 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:32:56.569825 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:32:56.572236 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:32:56.572236 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:32:56.572236 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:32:56.572236 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:32:56.572236 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:32:56.572236 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:32:56.572236 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:32:56.572236 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 755c0b10-e04a-42fa-86da-8cc65537315d could not be found. Jun 22 10:32:56.572236 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:32:56.572236 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:32:56.572236 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:32:56.572236 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:32:56.572236 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:32:56.572236 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:32:56.572236 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:32:56.572236 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:32:56.572236 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 755c0b10-e04a-42fa-86da-8cc65537315d could not be found. Jun 22 10:32:56.572236 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:32:56.575109 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-d98a746b-97fc-4ce5-8bec-e4126167841d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] Returning 404 to user: Instance 755c0b10-e04a-42fa-86da-8cc65537315d could not be found. {{(pid=117680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:32:56.576198 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-d98a746b-97fc-4ce5-8bec-e4126167841d tempest-AttachVolumeShelveTestJSON-414805869 tempest-AttachVolumeShelveTestJSON-414805869-project] 10.222.0.66 "GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d" status: 404 len: 111 microversion: 2.20 time: 0.053907 Jun 22 10:32:56.578602 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 492/962] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Jun 22 10:32:56 2022] GET /compute/v2.1/servers/755c0b10-e04a-42fa-86da-8cc65537315d => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 22 10:33:05.388684 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-81f7bf41-d1cd-489f-a12a-977cdcf4a872 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:33:05.389417 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-81f7bf41-d1cd-489f-a12a-977cdcf4a872 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 10d8ca63-dde5-47f0-a3d5-e0b2473d11ab] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:33:05.403261 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:05.403796 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-78c5785f-fb61-4a93-a7b7-50c159b6e56b req-e1b3e66a-877e-4139-9450-37998e9c0c19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10d8ca63-dde5-47f0-a3d5-e0b2473d11ab", "tag": "a4a63615-2666-4669-8e9d-a427ca0e615a"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:33:05.422410 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-81f7bf41-d1cd-489f-a12a-977cdcf4a872 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:05.424179 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-81f7bf41-d1cd-489f-a12a-977cdcf4a872 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:05.425417 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-81f7bf41-d1cd-489f-a12a-977cdcf4a872 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:05.426495 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-81f7bf41-d1cd-489f-a12a-977cdcf4a872 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:05.432130 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:05.432566 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_cell1:SELECT=80,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:05.444400 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-78c5785f-fb61-4a93-a7b7-50c159b6e56b req-e1b3e66a-877e-4139-9450-37998e9c0c19 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:05.464820 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-78c5785f-fb61-4a93-a7b7-50c159b6e56b req-e1b3e66a-877e-4139-9450-37998e9c0c19 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:05.489336 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-81f7bf41-d1cd-489f-a12a-977cdcf4a872 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 10d8ca63-dde5-47f0-a3d5-e0b2473d11ab] Going to try to terminate instance {{(pid=117679) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 10:33:05.496711 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:05.522005 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-78c5785f-fb61-4a93-a7b7-50c159b6e56b req-e1b3e66a-877e-4139-9450-37998e9c0c19 service nova] Creating event network-changed:a4a63615-2666-4669-8e9d-a427ca0e615a for instance 10d8ca63-dde5-47f0-a3d5-e0b2473d11ab on hv-cinder-84713 Jun 22 10:33:05.540928 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-78c5785f-fb61-4a93-a7b7-50c159b6e56b req-e1b3e66a-877e-4139-9450-37998e9c0c19 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149450 Jun 22 10:33:05.544205 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 493/963] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:33:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:33:05.724504 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-81f7bf41-d1cd-489f-a12a-977cdcf4a872 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "DELETE /compute/v2.1/servers/10d8ca63-dde5-47f0-a3d5-e0b2473d11ab" status: 204 len: 0 microversion: 2.1 time: 0.340961 Jun 22 10:33:05.727422 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 471/964] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Jun 22 10:33:05 2022] DELETE /compute/v2.1/servers/10d8ca63-dde5-47f0-a3d5-e0b2473d11ab => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 10:33:05.737141 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-5e7c5693-310f-4812-b28f-bcd8ab7c5b10 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:33:05.737862 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-5e7c5693-310f-4812-b28f-bcd8ab7c5b10 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 10d8ca63-dde5-47f0-a3d5-e0b2473d11ab] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:33:05.754111 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5e7c5693-310f-4812-b28f-bcd8ab7c5b10 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:05.755076 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5e7c5693-310f-4812-b28f-bcd8ab7c5b10 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:05.758140 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5e7c5693-310f-4812-b28f-bcd8ab7c5b10 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:05.763185 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5e7c5693-310f-4812-b28f-bcd8ab7c5b10 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:06.480762 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-5e7c5693-310f-4812-b28f-bcd8ab7c5b10 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a394fc62e6a64a85b855bf2eb56b4b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a87feacfb84d6c9f7ea48f230753b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:33:06.509093 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-5e7c5693-310f-4812-b28f-bcd8ab7c5b10 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "GET /compute/v2.1/servers/10d8ca63-dde5-47f0-a3d5-e0b2473d11ab" status: 200 len: 1577 microversion: 2.1 time: 0.775715 Jun 22 10:33:06.514978 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 494/965] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:33:05 2022] GET /compute/v2.1/servers/10d8ca63-dde5-47f0-a3d5-e0b2473d11ab => generated 1577 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:33:07.558844 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-aca6c465-29b7-4fa3-8007-34ba6f3cf192 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:33:07.594659 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-aca6c465-29b7-4fa3-8007-34ba6f3cf192 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 10d8ca63-dde5-47f0-a3d5-e0b2473d11ab] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:33:07.643432 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-aca6c465-29b7-4fa3-8007-34ba6f3cf192 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:07.644695 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-aca6c465-29b7-4fa3-8007-34ba6f3cf192 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:07.650971 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-aca6c465-29b7-4fa3-8007-34ba6f3cf192 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:07.653738 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-aca6c465-29b7-4fa3-8007-34ba6f3cf192 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:08.442392 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-aca6c465-29b7-4fa3-8007-34ba6f3cf192 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a394fc62e6a64a85b855bf2eb56b4b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a87feacfb84d6c9f7ea48f230753b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:33:08.459108 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-aca6c465-29b7-4fa3-8007-34ba6f3cf192 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "GET /compute/v2.1/servers/10d8ca63-dde5-47f0-a3d5-e0b2473d11ab" status: 200 len: 1577 microversion: 2.1 time: 0.916498 Jun 22 10:33:08.483007 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 472/966] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:33:07 2022] GET /compute/v2.1/servers/10d8ca63-dde5-47f0-a3d5-e0b2473d11ab => generated 1577 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:33:09.451459 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-0ae17db4-1588-49f7-aacc-e0af2a147d4a req-3626413f-8cfd-4919-a7d8-ebfd9d20a893 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10d8ca63-dde5-47f0-a3d5-e0b2473d11ab", "name": "network-vif-deleted", "tag": "a4a63615-2666-4669-8e9d-a427ca0e615a"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:33:09.468063 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-0ae17db4-1588-49f7-aacc-e0af2a147d4a req-3626413f-8cfd-4919-a7d8-ebfd9d20a893 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:09.468947 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-0ae17db4-1588-49f7-aacc-e0af2a147d4a req-3626413f-8cfd-4919-a7d8-ebfd9d20a893 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:09.492160 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-8290e138-8cc7-464c-8d14-549a08e80298 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:33:09.496557 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-8290e138-8cc7-464c-8d14-549a08e80298 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 10d8ca63-dde5-47f0-a3d5-e0b2473d11ab] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:33:09.509670 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-0ae17db4-1588-49f7-aacc-e0af2a147d4a req-3626413f-8cfd-4919-a7d8-ebfd9d20a893 service nova] Creating event network-vif-deleted:a4a63615-2666-4669-8e9d-a427ca0e615a for instance 10d8ca63-dde5-47f0-a3d5-e0b2473d11ab on hv-cinder-84713 Jun 22 10:33:09.524966 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-0ae17db4-1588-49f7-aacc-e0af2a147d4a req-3626413f-8cfd-4919-a7d8-ebfd9d20a893 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.517010 Jun 22 10:33:09.525194 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8290e138-8cc7-464c-8d14-549a08e80298 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:09.527116 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 495/967] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:33:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:33:09.530245 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8290e138-8cc7-464c-8d14-549a08e80298 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:09.532468 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8290e138-8cc7-464c-8d14-549a08e80298 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:09.536889 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8290e138-8cc7-464c-8d14-549a08e80298 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:09.610138 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8290e138-8cc7-464c-8d14-549a08e80298 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:09.611182 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8290e138-8cc7-464c-8d14-549a08e80298 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:09.612005 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.objects.instance [None req-8290e138-8cc7-464c-8d14-549a08e80298 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lazy-loading 'fault' on Instance uuid 10d8ca63-dde5-47f0-a3d5-e0b2473d11ab {{(pid=117679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:33:09.715518 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-8290e138-8cc7-464c-8d14-549a08e80298 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a394fc62e6a64a85b855bf2eb56b4b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a87feacfb84d6c9f7ea48f230753b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:33:09.728801 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-8290e138-8cc7-464c-8d14-549a08e80298 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "GET /compute/v2.1/servers/10d8ca63-dde5-47f0-a3d5-e0b2473d11ab" status: 200 len: 1228 microversion: 2.1 time: 0.240942 Jun 22 10:33:09.729911 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 473/968] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:33:09 2022] GET /compute/v2.1/servers/10d8ca63-dde5-47f0-a3d5-e0b2473d11ab => generated 1228 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:33:10.758552 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-885906e7-b427-46fa-8f6a-5b02d9c926f8 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:33:10.763792 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-885906e7-b427-46fa-8f6a-5b02d9c926f8 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 10d8ca63-dde5-47f0-a3d5-e0b2473d11ab] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:33:10.777160 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-885906e7-b427-46fa-8f6a-5b02d9c926f8 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:10.779577 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-885906e7-b427-46fa-8f6a-5b02d9c926f8 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:10.781560 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-885906e7-b427-46fa-8f6a-5b02d9c926f8 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:10.782703 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-885906e7-b427-46fa-8f6a-5b02d9c926f8 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:10.837254 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.wsgi [None req-885906e7-b427-46fa-8f6a-5b02d9c926f8 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] HTTP exception thrown: Instance 10d8ca63-dde5-47f0-a3d5-e0b2473d11ab could not be found. Jun 22 10:33:10.851303 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-885906e7-b427-46fa-8f6a-5b02d9c926f8 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Request method failure captured: Jun 22 10:33:10.851303 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: request: GET /compute/v2.1/servers/10d8ca63-dde5-47f0-a3d5-e0b2473d11ab HTTP/1.1 Jun 22 10:33:10.851303 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Accept: application/json Jun 22 10:33:10.851303 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Accept-Encoding: identity Jun 22 10:33:10.851303 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Connection: close Jun 22 10:33:10.851303 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Content-Length: 0 Jun 22 10:33:10.851303 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Content-Type: application/json Jun 22 10:33:10.851303 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Host: 10.222.0.66 Jun 22 10:33:10.851303 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Openstack-System-Scope: None Jun 22 10:33:10.851303 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: User-Agent: python-urllib3/1.26.9 Jun 22 10:33:10.851303 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Auth-Token: gAAAAABisu1hytug7xP2j9RUJNGU87H2Yo7IxEXR9u7fu_LBOaV_q-xfR4gL2EA57uffwLCfFRfDDnIPlNf72rNz3G_3Pm4CJ99xXb8xpQIKUOzCbcLhgMBqZKgkTxEGrZBD1NtZuYmIKLZL9BApVW0LVQy4L9apbdMwQ5H09uY5fFaCygpiMyU Jun 22 10:33:10.851303 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Domain-Id: None Jun 22 10:33:10.851303 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Domain-Name: None Jun 22 10:33:10.851303 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Identity-Status: Confirmed Jun 22 10:33:10.851303 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Is-Admin-Project: True Jun 22 10:33:10.851303 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Domain-Id: default Jun 22 10:33:10.851303 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Domain-Name: Default Jun 22 10:33:10.851303 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Id: a4a87feacfb84d6c9f7ea48f230753b7 Jun 22 10:33:10.851303 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Name: tempest-TestVolumeBootPattern-1655045960 Jun 22 10:33:10.851303 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Role: member,reader Jun 22 10:33:10.851303 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Roles: member,reader Jun 22 10:33:10.854428 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_a4a87feacfb84d6c9f7ea48f230753b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a4a87feacfb84d6c9f7ea48f230753b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/a4a87feacfb84d6c9f7ea48f230753b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a4a87feacfb84d6c9f7ea48f230753b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}] Jun 22 10:33:10.854428 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant: tempest-TestVolumeBootPattern-1655045960 Jun 22 10:33:10.854428 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant-Id: a4a87feacfb84d6c9f7ea48f230753b7 Jun 22 10:33:10.854428 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant-Name: tempest-TestVolumeBootPattern-1655045960 Jun 22 10:33:10.854428 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User: tempest-TestVolumeBootPattern-1655045960-project Jun 22 10:33:10.854428 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Domain-Id: default Jun 22 10:33:10.854428 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Domain-Name: Default Jun 22 10:33:10.854428 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Id: a394fc62e6a64a85b855bf2eb56b4b71 Jun 22 10:33:10.854428 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Name: tempest-TestVolumeBootPattern-1655045960-project Jun 22 10:33:10.854428 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: method: > Jun 22 10:33:10.854428 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: exception: Instance 10d8ca63-dde5-47f0-a3d5-e0b2473d11ab could not be found. Jun 22 10:33:10.854428 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: action_args: {'id': '10d8ca63-dde5-47f0-a3d5-e0b2473d11ab'} Jun 22 10:33:10.856165 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:33:10.856165 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:33:10.856165 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:33:10.856165 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:33:10.856165 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:33:10.856165 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:33:10.856165 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:33:10.856165 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:33:10.856165 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:33:10.856165 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:33:10.856165 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10d8ca63-dde5-47f0-a3d5-e0b2473d11ab could not be found. Jun 22 10:33:10.856165 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:33:10.856165 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:33:10.856165 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:33:10.856165 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:33:10.856165 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:33:10.856165 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:33:10.856165 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:33:10.856165 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:33:10.856165 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:33:10.859622 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:33:10.859622 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:33:10.859622 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:33:10.859622 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:33:10.859622 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:33:10.859622 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:33:10.859622 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:33:10.859622 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10d8ca63-dde5-47f0-a3d5-e0b2473d11ab could not be found. Jun 22 10:33:10.859622 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:33:10.859622 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:33:10.859622 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:33:10.859622 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:33:10.859622 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:33:10.859622 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:33:10.859622 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:33:10.859622 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:33:10.859622 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10d8ca63-dde5-47f0-a3d5-e0b2473d11ab could not be found. Jun 22 10:33:10.859622 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:33:10.872087 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-885906e7-b427-46fa-8f6a-5b02d9c926f8 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Returning 404 to user: Instance 10d8ca63-dde5-47f0-a3d5-e0b2473d11ab could not be found. {{(pid=117680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:33:10.872087 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-885906e7-b427-46fa-8f6a-5b02d9c926f8 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "GET /compute/v2.1/servers/10d8ca63-dde5-47f0-a3d5-e0b2473d11ab" status: 404 len: 111 microversion: 2.1 time: 0.119568 Jun 22 10:33:10.872087 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 496/969] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:33:10 2022] GET /compute/v2.1/servers/10d8ca63-dde5-47f0-a3d5-e0b2473d11ab => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:33:15.625353 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-41e5b5f3-23c5-4376-88cf-63b16cbb6e96 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:33:15.626932 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-4fe5acad-a32c-44a8-9e48-f6976a7c111d req-23aaec1d-5c73-421d-bd91-5f1d4d26b7ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "360c07f1-5b2e-41c9-a44e-d547784cf097", "tag": "2e43553e-4d3a-4e20-b17c-54a25459963b"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:33:15.627641 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-41e5b5f3-23c5-4376-88cf-63b16cbb6e96 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 360c07f1-5b2e-41c9-a44e-d547784cf097] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:33:15.646557 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-41e5b5f3-23c5-4376-88cf-63b16cbb6e96 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:15.648610 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-41e5b5f3-23c5-4376-88cf-63b16cbb6e96 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:15.651131 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-41e5b5f3-23c5-4376-88cf-63b16cbb6e96 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:15.652250 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-41e5b5f3-23c5-4376-88cf-63b16cbb6e96 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:15.663256 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-4fe5acad-a32c-44a8-9e48-f6976a7c111d req-23aaec1d-5c73-421d-bd91-5f1d4d26b7ec service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:15.667687 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-4fe5acad-a32c-44a8-9e48-f6976a7c111d req-23aaec1d-5c73-421d-bd91-5f1d4d26b7ec service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:15.710294 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-4fe5acad-a32c-44a8-9e48-f6976a7c111d req-23aaec1d-5c73-421d-bd91-5f1d4d26b7ec service nova] Creating event network-changed:2e43553e-4d3a-4e20-b17c-54a25459963b for instance 360c07f1-5b2e-41c9-a44e-d547784cf097 on hv-cinder-84713 Jun 22 10:33:15.718026 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-41e5b5f3-23c5-4376-88cf-63b16cbb6e96 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 360c07f1-5b2e-41c9-a44e-d547784cf097] Going to try to terminate instance {{(pid=117679) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 10:33:15.721488 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-4fe5acad-a32c-44a8-9e48-f6976a7c111d req-23aaec1d-5c73-421d-bd91-5f1d4d26b7ec service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098844 Jun 22 10:33:15.722952 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 497/970] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:33:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:33:15.907271 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-41e5b5f3-23c5-4376-88cf-63b16cbb6e96 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "DELETE /compute/v2.1/servers/360c07f1-5b2e-41c9-a44e-d547784cf097" status: 204 len: 0 microversion: 2.1 time: 0.290666 Jun 22 10:33:15.918149 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 474/971] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Jun 22 10:33:15 2022] DELETE /compute/v2.1/servers/360c07f1-5b2e-41c9-a44e-d547784cf097 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 10:33:15.927764 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-f7c72a1f-17ae-4dc1-9877-399e7587e716 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:33:15.932768 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-f7c72a1f-17ae-4dc1-9877-399e7587e716 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 360c07f1-5b2e-41c9-a44e-d547784cf097] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:33:15.947535 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f7c72a1f-17ae-4dc1-9877-399e7587e716 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:15.949116 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f7c72a1f-17ae-4dc1-9877-399e7587e716 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:15.950407 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f7c72a1f-17ae-4dc1-9877-399e7587e716 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:15.951285 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f7c72a1f-17ae-4dc1-9877-399e7587e716 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:16.241574 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-f7c72a1f-17ae-4dc1-9877-399e7587e716 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a394fc62e6a64a85b855bf2eb56b4b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a87feacfb84d6c9f7ea48f230753b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:33:16.272734 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-f7c72a1f-17ae-4dc1-9877-399e7587e716 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "GET /compute/v2.1/servers/360c07f1-5b2e-41c9-a44e-d547784cf097" status: 200 len: 1577 microversion: 2.1 time: 0.345387 Jun 22 10:33:16.276318 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 498/972] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:33:15 2022] GET /compute/v2.1/servers/360c07f1-5b2e-41c9-a44e-d547784cf097 => generated 1577 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:33:17.304606 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-643686ef-f10c-4fcb-b0e5-65319ed4f2f9 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:33:17.305439 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-643686ef-f10c-4fcb-b0e5-65319ed4f2f9 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 360c07f1-5b2e-41c9-a44e-d547784cf097] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:33:17.321010 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-643686ef-f10c-4fcb-b0e5-65319ed4f2f9 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:17.326313 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-643686ef-f10c-4fcb-b0e5-65319ed4f2f9 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:17.342586 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-643686ef-f10c-4fcb-b0e5-65319ed4f2f9 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:17.342586 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-643686ef-f10c-4fcb-b0e5-65319ed4f2f9 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:17.560071 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-643686ef-f10c-4fcb-b0e5-65319ed4f2f9 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a394fc62e6a64a85b855bf2eb56b4b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a87feacfb84d6c9f7ea48f230753b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:33:17.587699 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-643686ef-f10c-4fcb-b0e5-65319ed4f2f9 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "GET /compute/v2.1/servers/360c07f1-5b2e-41c9-a44e-d547784cf097" status: 200 len: 1509 microversion: 2.1 time: 0.287741 Jun 22 10:33:17.595464 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 475/973] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:33:17 2022] GET /compute/v2.1/servers/360c07f1-5b2e-41c9-a44e-d547784cf097 => generated 1509 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:33:17.763184 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-51aa5cad-39da-4a6a-9e5a-00b2ae1d712c req-28805e00-cd7f-411a-a25f-8caa6f72cc95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "360c07f1-5b2e-41c9-a44e-d547784cf097", "name": "network-vif-deleted", "tag": "2e43553e-4d3a-4e20-b17c-54a25459963b"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:33:17.803493 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-51aa5cad-39da-4a6a-9e5a-00b2ae1d712c req-28805e00-cd7f-411a-a25f-8caa6f72cc95 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:17.804318 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-51aa5cad-39da-4a6a-9e5a-00b2ae1d712c req-28805e00-cd7f-411a-a25f-8caa6f72cc95 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:17.822034 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-51aa5cad-39da-4a6a-9e5a-00b2ae1d712c req-28805e00-cd7f-411a-a25f-8caa6f72cc95 service nova] Creating event network-vif-deleted:2e43553e-4d3a-4e20-b17c-54a25459963b for instance 360c07f1-5b2e-41c9-a44e-d547784cf097 on hv-cinder-84713 Jun 22 10:33:17.855335 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-51aa5cad-39da-4a6a-9e5a-00b2ae1d712c req-28805e00-cd7f-411a-a25f-8caa6f72cc95 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100130 Jun 22 10:33:17.858429 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 499/974] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:33:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:33:18.632273 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-b2f334d0-81cf-4b66-be86-bd8049829597 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:33:18.634326 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-b2f334d0-81cf-4b66-be86-bd8049829597 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 360c07f1-5b2e-41c9-a44e-d547784cf097] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:33:18.653385 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b2f334d0-81cf-4b66-be86-bd8049829597 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:18.654430 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b2f334d0-81cf-4b66-be86-bd8049829597 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:18.656022 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b2f334d0-81cf-4b66-be86-bd8049829597 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:18.657090 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b2f334d0-81cf-4b66-be86-bd8049829597 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:18.759639 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-b2f334d0-81cf-4b66-be86-bd8049829597 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a394fc62e6a64a85b855bf2eb56b4b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a87feacfb84d6c9f7ea48f230753b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:33:18.773927 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-b2f334d0-81cf-4b66-be86-bd8049829597 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "GET /compute/v2.1/servers/360c07f1-5b2e-41c9-a44e-d547784cf097" status: 200 len: 1390 microversion: 2.1 time: 0.159547 Jun 22 10:33:18.775313 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 476/975] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:33:18 2022] GET /compute/v2.1/servers/360c07f1-5b2e-41c9-a44e-d547784cf097 => generated 1390 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:33:19.799928 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-20793c7e-6967-46f1-a995-fbafce7803ec tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:33:19.801151 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-20793c7e-6967-46f1-a995-fbafce7803ec tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 360c07f1-5b2e-41c9-a44e-d547784cf097] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:33:19.814949 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-20793c7e-6967-46f1-a995-fbafce7803ec tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:19.815602 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-20793c7e-6967-46f1-a995-fbafce7803ec tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:19.817727 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-20793c7e-6967-46f1-a995-fbafce7803ec tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:19.818766 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-20793c7e-6967-46f1-a995-fbafce7803ec tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:19.936402 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-20793c7e-6967-46f1-a995-fbafce7803ec tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a394fc62e6a64a85b855bf2eb56b4b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a87feacfb84d6c9f7ea48f230753b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:33:19.951389 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-20793c7e-6967-46f1-a995-fbafce7803ec tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "GET /compute/v2.1/servers/360c07f1-5b2e-41c9-a44e-d547784cf097" status: 200 len: 1224 microversion: 2.1 time: 0.158852 Jun 22 10:33:19.952808 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 500/976] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:33:19 2022] GET /compute/v2.1/servers/360c07f1-5b2e-41c9-a44e-d547784cf097 => generated 1224 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:33:20.973744 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-5cdc970a-9e07-4217-80f7-97c51d50e47a tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:33:20.974872 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-5cdc970a-9e07-4217-80f7-97c51d50e47a tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 360c07f1-5b2e-41c9-a44e-d547784cf097] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:33:20.988676 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5cdc970a-9e07-4217-80f7-97c51d50e47a tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:20.992472 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5cdc970a-9e07-4217-80f7-97c51d50e47a tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:20.993671 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5cdc970a-9e07-4217-80f7-97c51d50e47a tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:20.994277 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5cdc970a-9e07-4217-80f7-97c51d50e47a tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:21.064219 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5cdc970a-9e07-4217-80f7-97c51d50e47a tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:21.064942 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5cdc970a-9e07-4217-80f7-97c51d50e47a tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:21.065678 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.objects.instance [None req-5cdc970a-9e07-4217-80f7-97c51d50e47a tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lazy-loading 'fault' on Instance uuid 360c07f1-5b2e-41c9-a44e-d547784cf097 {{(pid=117679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:33:21.155934 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-5cdc970a-9e07-4217-80f7-97c51d50e47a tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a394fc62e6a64a85b855bf2eb56b4b71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4a87feacfb84d6c9f7ea48f230753b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:33:21.176631 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-5cdc970a-9e07-4217-80f7-97c51d50e47a tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "GET /compute/v2.1/servers/360c07f1-5b2e-41c9-a44e-d547784cf097" status: 200 len: 1229 microversion: 2.1 time: 0.209324 Jun 22 10:33:21.178420 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 477/977] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:33:20 2022] GET /compute/v2.1/servers/360c07f1-5b2e-41c9-a44e-d547784cf097 => generated 1229 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:33:22.201142 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-8ac45dd3-cc8e-46e1-92d0-aad47fe45faf tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:33:22.202431 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-8ac45dd3-cc8e-46e1-92d0-aad47fe45faf tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 360c07f1-5b2e-41c9-a44e-d547784cf097] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:33:22.238592 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8ac45dd3-cc8e-46e1-92d0-aad47fe45faf tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:22.239395 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8ac45dd3-cc8e-46e1-92d0-aad47fe45faf tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:22.241347 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8ac45dd3-cc8e-46e1-92d0-aad47fe45faf tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:22.241989 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8ac45dd3-cc8e-46e1-92d0-aad47fe45faf tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:22.261104 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.wsgi [None req-8ac45dd3-cc8e-46e1-92d0-aad47fe45faf tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] HTTP exception thrown: Instance 360c07f1-5b2e-41c9-a44e-d547784cf097 could not be found. Jun 22 10:33:22.262842 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-8ac45dd3-cc8e-46e1-92d0-aad47fe45faf tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Request method failure captured: Jun 22 10:33:22.262842 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: request: GET /compute/v2.1/servers/360c07f1-5b2e-41c9-a44e-d547784cf097 HTTP/1.1 Jun 22 10:33:22.262842 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Accept: application/json Jun 22 10:33:22.262842 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Accept-Encoding: identity Jun 22 10:33:22.262842 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Connection: close Jun 22 10:33:22.262842 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Content-Length: 0 Jun 22 10:33:22.262842 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Content-Type: application/json Jun 22 10:33:22.262842 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Host: 10.222.0.66 Jun 22 10:33:22.262842 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Openstack-System-Scope: None Jun 22 10:33:22.262842 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: User-Agent: python-urllib3/1.26.9 Jun 22 10:33:22.262842 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Auth-Token: gAAAAABisu1hytug7xP2j9RUJNGU87H2Yo7IxEXR9u7fu_LBOaV_q-xfR4gL2EA57uffwLCfFRfDDnIPlNf72rNz3G_3Pm4CJ99xXb8xpQIKUOzCbcLhgMBqZKgkTxEGrZBD1NtZuYmIKLZL9BApVW0LVQy4L9apbdMwQ5H09uY5fFaCygpiMyU Jun 22 10:33:22.262842 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Domain-Id: None Jun 22 10:33:22.262842 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Domain-Name: None Jun 22 10:33:22.262842 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Identity-Status: Confirmed Jun 22 10:33:22.262842 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Is-Admin-Project: True Jun 22 10:33:22.262842 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Domain-Id: default Jun 22 10:33:22.262842 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Domain-Name: Default Jun 22 10:33:22.262842 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Id: a4a87feacfb84d6c9f7ea48f230753b7 Jun 22 10:33:22.262842 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Name: tempest-TestVolumeBootPattern-1655045960 Jun 22 10:33:22.262842 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Role: member,reader Jun 22 10:33:22.262842 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Roles: member,reader Jun 22 10:33:22.264711 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_a4a87feacfb84d6c9f7ea48f230753b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a4a87feacfb84d6c9f7ea48f230753b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/a4a87feacfb84d6c9f7ea48f230753b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a4a87feacfb84d6c9f7ea48f230753b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}] Jun 22 10:33:22.264711 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant: tempest-TestVolumeBootPattern-1655045960 Jun 22 10:33:22.264711 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant-Id: a4a87feacfb84d6c9f7ea48f230753b7 Jun 22 10:33:22.264711 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant-Name: tempest-TestVolumeBootPattern-1655045960 Jun 22 10:33:22.264711 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User: tempest-TestVolumeBootPattern-1655045960-project Jun 22 10:33:22.264711 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Domain-Id: default Jun 22 10:33:22.264711 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Domain-Name: Default Jun 22 10:33:22.264711 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Id: a394fc62e6a64a85b855bf2eb56b4b71 Jun 22 10:33:22.264711 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Name: tempest-TestVolumeBootPattern-1655045960-project Jun 22 10:33:22.264711 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: method: > Jun 22 10:33:22.264711 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: exception: Instance 360c07f1-5b2e-41c9-a44e-d547784cf097 could not be found. Jun 22 10:33:22.264711 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: action_args: {'id': '360c07f1-5b2e-41c9-a44e-d547784cf097'} Jun 22 10:33:22.265850 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:33:22.265850 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:33:22.265850 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:33:22.265850 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:33:22.265850 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:33:22.265850 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:33:22.265850 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:33:22.265850 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:33:22.265850 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:33:22.265850 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:33:22.265850 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 360c07f1-5b2e-41c9-a44e-d547784cf097 could not be found. Jun 22 10:33:22.265850 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:33:22.265850 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:33:22.265850 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:33:22.265850 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:33:22.265850 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:33:22.265850 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:33:22.265850 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:33:22.265850 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:33:22.265850 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:33:22.267493 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:33:22.267493 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:33:22.267493 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:33:22.267493 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:33:22.267493 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:33:22.267493 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:33:22.267493 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:33:22.267493 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 360c07f1-5b2e-41c9-a44e-d547784cf097 could not be found. Jun 22 10:33:22.267493 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:33:22.267493 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:33:22.267493 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:33:22.267493 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:33:22.267493 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:33:22.267493 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:33:22.267493 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:33:22.267493 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:33:22.267493 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 360c07f1-5b2e-41c9-a44e-d547784cf097 could not be found. Jun 22 10:33:22.267493 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:33:22.269061 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-8ac45dd3-cc8e-46e1-92d0-aad47fe45faf tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Returning 404 to user: Instance 360c07f1-5b2e-41c9-a44e-d547784cf097 could not be found. {{(pid=117680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:33:22.269061 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-8ac45dd3-cc8e-46e1-92d0-aad47fe45faf tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "GET /compute/v2.1/servers/360c07f1-5b2e-41c9-a44e-d547784cf097" status: 404 len: 111 microversion: 2.1 time: 0.067707 Jun 22 10:33:22.269061 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 501/978] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:33:22 2022] GET /compute/v2.1/servers/360c07f1-5b2e-41c9-a44e-d547784cf097 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:33:22.914122 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-d8e27923-17e3-4d2e-9211-c2a7a364fae4 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:33:22.914846 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-d8e27923-17e3-4d2e-9211-c2a7a364fae4 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 3cc6d1fb-02b4-411e-84a2-eb5a63344e0d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:33:22.922732 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d8e27923-17e3-4d2e-9211-c2a7a364fae4 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:22.923284 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d8e27923-17e3-4d2e-9211-c2a7a364fae4 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:22.926701 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d8e27923-17e3-4d2e-9211-c2a7a364fae4 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:22.926701 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d8e27923-17e3-4d2e-9211-c2a7a364fae4 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:22.943744 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.wsgi [None req-d8e27923-17e3-4d2e-9211-c2a7a364fae4 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] HTTP exception thrown: Instance 3cc6d1fb-02b4-411e-84a2-eb5a63344e0d could not be found. Jun 22 10:33:22.945686 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-d8e27923-17e3-4d2e-9211-c2a7a364fae4 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Request method failure captured: Jun 22 10:33:22.945686 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: request: DELETE /compute/v2.1/servers/3cc6d1fb-02b4-411e-84a2-eb5a63344e0d HTTP/1.1 Jun 22 10:33:22.945686 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Accept: application/json Jun 22 10:33:22.945686 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Accept-Encoding: identity Jun 22 10:33:22.945686 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Connection: close Jun 22 10:33:22.945686 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Content-Length: 0 Jun 22 10:33:22.945686 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Content-Type: application/json Jun 22 10:33:22.945686 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Host: 10.222.0.66 Jun 22 10:33:22.945686 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Openstack-System-Scope: None Jun 22 10:33:22.945686 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: User-Agent: python-urllib3/1.26.9 Jun 22 10:33:22.945686 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Auth-Token: gAAAAABisu1hytug7xP2j9RUJNGU87H2Yo7IxEXR9u7fu_LBOaV_q-xfR4gL2EA57uffwLCfFRfDDnIPlNf72rNz3G_3Pm4CJ99xXb8xpQIKUOzCbcLhgMBqZKgkTxEGrZBD1NtZuYmIKLZL9BApVW0LVQy4L9apbdMwQ5H09uY5fFaCygpiMyU Jun 22 10:33:22.945686 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Domain-Id: None Jun 22 10:33:22.945686 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Domain-Name: None Jun 22 10:33:22.945686 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Identity-Status: Confirmed Jun 22 10:33:22.945686 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Is-Admin-Project: True Jun 22 10:33:22.945686 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Domain-Id: default Jun 22 10:33:22.945686 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Domain-Name: Default Jun 22 10:33:22.945686 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Id: a4a87feacfb84d6c9f7ea48f230753b7 Jun 22 10:33:22.945686 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Name: tempest-TestVolumeBootPattern-1655045960 Jun 22 10:33:22.945686 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Role: member,reader Jun 22 10:33:22.945686 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Roles: member,reader Jun 22 10:33:22.949072 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_a4a87feacfb84d6c9f7ea48f230753b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a4a87feacfb84d6c9f7ea48f230753b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/a4a87feacfb84d6c9f7ea48f230753b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a4a87feacfb84d6c9f7ea48f230753b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}] Jun 22 10:33:22.949072 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Tenant: tempest-TestVolumeBootPattern-1655045960 Jun 22 10:33:22.949072 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Tenant-Id: a4a87feacfb84d6c9f7ea48f230753b7 Jun 22 10:33:22.949072 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Tenant-Name: tempest-TestVolumeBootPattern-1655045960 Jun 22 10:33:22.949072 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User: tempest-TestVolumeBootPattern-1655045960-project Jun 22 10:33:22.949072 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Domain-Id: default Jun 22 10:33:22.949072 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Domain-Name: Default Jun 22 10:33:22.949072 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Id: a394fc62e6a64a85b855bf2eb56b4b71 Jun 22 10:33:22.949072 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Name: tempest-TestVolumeBootPattern-1655045960-project Jun 22 10:33:22.949072 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: method: > Jun 22 10:33:22.949072 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: exception: Instance 3cc6d1fb-02b4-411e-84a2-eb5a63344e0d could not be found. Jun 22 10:33:22.949072 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: action_args: {'id': '3cc6d1fb-02b4-411e-84a2-eb5a63344e0d'} Jun 22 10:33:22.951128 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:33:22.951128 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:33:22.951128 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:33:22.951128 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:33:22.951128 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:33:22.951128 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:33:22.951128 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:33:22.951128 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:33:22.951128 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:33:22.951128 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:33:22.951128 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cc6d1fb-02b4-411e-84a2-eb5a63344e0d could not be found. Jun 22 10:33:22.951128 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:33:22.951128 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:33:22.951128 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:33:22.951128 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:33:22.951128 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:33:22.951128 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:33:22.951128 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:33:22.951128 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:33:22.951128 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:33:22.955399 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:33:22.955399 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 22 10:33:22.955399 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 22 10:33:22.955399 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 22 10:33:22.955399 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 22 10:33:22.955399 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:33:22.955399 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:33:22.955399 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:33:22.955399 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:33:22.955399 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cc6d1fb-02b4-411e-84a2-eb5a63344e0d could not be found. Jun 22 10:33:22.955399 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:33:22.955399 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:33:22.955399 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:33:22.955399 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:33:22.955399 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:33:22.955399 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:33:22.955399 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:33:22.955399 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:33:22.955399 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cc6d1fb-02b4-411e-84a2-eb5a63344e0d could not be found. Jun 22 10:33:22.955399 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:33:22.958247 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-d8e27923-17e3-4d2e-9211-c2a7a364fae4 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Returning 404 to user: Instance 3cc6d1fb-02b4-411e-84a2-eb5a63344e0d could not be found. {{(pid=117679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:33:22.958247 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-d8e27923-17e3-4d2e-9211-c2a7a364fae4 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "DELETE /compute/v2.1/servers/3cc6d1fb-02b4-411e-84a2-eb5a63344e0d" status: 404 len: 111 microversion: 2.1 time: 0.038640 Jun 22 10:33:22.958600 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-54d8c306-1d8c-4b12-bd2c-eb6b3f95558e tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Action: 'create', calling method: .version_select at 0x7f60d97d7040>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-388445002", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDe43BdDI1v3w2IVRWfuHog8YhUDYQRLv+Pfr4M5QNDt6G5dMK7zrAbDKecT7X72tQK8q78ayH33XZ5ZynQTubZPrVRb3VKxk8mhW7G+Y3tP6W0Pq8b5DmBiwHNjOgEdzw=="}} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:33:22.958831 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 478/979] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Jun 22 10:33:22 2022] DELETE /compute/v2.1/servers/3cc6d1fb-02b4-411e-84a2-eb5a63344e0d => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:33:22.962272 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-52e1300b-9035-4d44-aecb-1996ae0aa3f7 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:33:22.963281 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-52e1300b-9035-4d44-aecb-1996ae0aa3f7 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] [instance: 3cc6d1fb-02b4-411e-84a2-eb5a63344e0d] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:33:22.971806 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-52e1300b-9035-4d44-aecb-1996ae0aa3f7 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:22.972440 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-52e1300b-9035-4d44-aecb-1996ae0aa3f7 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:22.973349 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-52e1300b-9035-4d44-aecb-1996ae0aa3f7 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:22.974093 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-52e1300b-9035-4d44-aecb-1996ae0aa3f7 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:22.974965 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.quota [None req-54d8c306-1d8c-4b12-bd2c-eb6b3f95558e tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Getting quotas for project 0ead3712348245f8862718ef0e30b3c0. Resources: {'key_pairs'} {{(pid=117680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:33:22.979960 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.quota [None req-54d8c306-1d8c-4b12-bd2c-eb6b3f95558e tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Getting quotas for user 172df9a596fd4729967f3787533ea57d and project 0ead3712348245f8862718ef0e30b3c0. Resources: {'key_pairs'} {{(pid=117680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:33:22.991202 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.wsgi [None req-52e1300b-9035-4d44-aecb-1996ae0aa3f7 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] HTTP exception thrown: Instance 3cc6d1fb-02b4-411e-84a2-eb5a63344e0d could not be found. Jun 22 10:33:22.992986 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-52e1300b-9035-4d44-aecb-1996ae0aa3f7 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Request method failure captured: Jun 22 10:33:22.992986 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: request: GET /compute/v2.1/servers/3cc6d1fb-02b4-411e-84a2-eb5a63344e0d HTTP/1.1 Jun 22 10:33:22.992986 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Accept: application/json Jun 22 10:33:22.992986 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Accept-Encoding: identity Jun 22 10:33:22.992986 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Connection: close Jun 22 10:33:22.992986 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Content-Length: 0 Jun 22 10:33:22.992986 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Content-Type: application/json Jun 22 10:33:22.992986 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Host: 10.222.0.66 Jun 22 10:33:22.992986 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Openstack-System-Scope: None Jun 22 10:33:22.992986 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: User-Agent: python-urllib3/1.26.9 Jun 22 10:33:22.992986 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Auth-Token: gAAAAABisu1hytug7xP2j9RUJNGU87H2Yo7IxEXR9u7fu_LBOaV_q-xfR4gL2EA57uffwLCfFRfDDnIPlNf72rNz3G_3Pm4CJ99xXb8xpQIKUOzCbcLhgMBqZKgkTxEGrZBD1NtZuYmIKLZL9BApVW0LVQy4L9apbdMwQ5H09uY5fFaCygpiMyU Jun 22 10:33:22.992986 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Domain-Id: None Jun 22 10:33:22.992986 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Domain-Name: None Jun 22 10:33:22.992986 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Identity-Status: Confirmed Jun 22 10:33:22.992986 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Is-Admin-Project: True Jun 22 10:33:22.992986 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Domain-Id: default Jun 22 10:33:22.992986 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Domain-Name: Default Jun 22 10:33:22.992986 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Id: a4a87feacfb84d6c9f7ea48f230753b7 Jun 22 10:33:22.992986 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Name: tempest-TestVolumeBootPattern-1655045960 Jun 22 10:33:22.992986 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Role: member,reader Jun 22 10:33:22.992986 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Roles: member,reader Jun 22 10:33:22.995818 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_a4a87feacfb84d6c9f7ea48f230753b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a4a87feacfb84d6c9f7ea48f230753b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/a4a87feacfb84d6c9f7ea48f230753b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a4a87feacfb84d6c9f7ea48f230753b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}] Jun 22 10:33:22.995818 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Tenant: tempest-TestVolumeBootPattern-1655045960 Jun 22 10:33:22.995818 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Tenant-Id: a4a87feacfb84d6c9f7ea48f230753b7 Jun 22 10:33:22.995818 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Tenant-Name: tempest-TestVolumeBootPattern-1655045960 Jun 22 10:33:22.995818 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User: tempest-TestVolumeBootPattern-1655045960-project Jun 22 10:33:22.995818 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Domain-Id: default Jun 22 10:33:22.995818 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Domain-Name: Default Jun 22 10:33:22.995818 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Id: a394fc62e6a64a85b855bf2eb56b4b71 Jun 22 10:33:22.995818 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Name: tempest-TestVolumeBootPattern-1655045960-project Jun 22 10:33:22.995818 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: method: > Jun 22 10:33:22.995818 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: exception: Instance 3cc6d1fb-02b4-411e-84a2-eb5a63344e0d could not be found. Jun 22 10:33:22.995818 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: action_args: {'id': '3cc6d1fb-02b4-411e-84a2-eb5a63344e0d'} Jun 22 10:33:22.998757 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:33:22.998757 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:33:22.998757 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:33:22.998757 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:33:22.998757 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:33:22.998757 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:33:22.998757 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:33:22.998757 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:33:22.998757 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:33:22.998757 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:33:22.998757 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cc6d1fb-02b4-411e-84a2-eb5a63344e0d could not be found. Jun 22 10:33:22.998757 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:33:22.998757 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:33:22.998757 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:33:22.998757 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:33:22.998757 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:33:22.998757 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:33:22.998757 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:33:22.998757 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:33:22.998757 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:33:23.002641 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:33:23.002641 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:33:23.002641 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:33:23.002641 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:33:23.002641 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:33:23.002641 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:33:23.002641 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:33:23.002641 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cc6d1fb-02b4-411e-84a2-eb5a63344e0d could not be found. Jun 22 10:33:23.002641 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:33:23.002641 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:33:23.002641 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:33:23.002641 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:33:23.002641 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:33:23.002641 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:33:23.002641 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:33:23.002641 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:33:23.002641 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cc6d1fb-02b4-411e-84a2-eb5a63344e0d could not be found. Jun 22 10:33:23.002641 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:33:23.006088 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-52e1300b-9035-4d44-aecb-1996ae0aa3f7 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Returning 404 to user: Instance 3cc6d1fb-02b4-411e-84a2-eb5a63344e0d could not be found. {{(pid=117679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:33:23.006088 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-52e1300b-9035-4d44-aecb-1996ae0aa3f7 tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "GET /compute/v2.1/servers/3cc6d1fb-02b4-411e-84a2-eb5a63344e0d" status: 404 len: 111 microversion: 2.1 time: 0.039258 Jun 22 10:33:23.006088 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 479/980] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:33:22 2022] GET /compute/v2.1/servers/3cc6d1fb-02b4-411e-84a2-eb5a63344e0d => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 22 10:33:23.017424 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-54d8c306-1d8c-4b12-bd2c-eb6b3f95558e tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.072857 Jun 22 10:33:23.018399 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 502/981] 10.222.0.66 () {60 vars in 1158 bytes} [Wed Jun 22 10:33:22 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:33:23.149633 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-d74deba0-6180-4341-9550-fb08a33d3395 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1516509622", "imageRef": "7172d191-99fa-4494-b27e-c571f68b249d", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-388445002", "networks": [{"uuid": "f2ecf893-7204-4ed2-bd73-cc492f6006b2"}]}} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:33:23.228776 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.network.neutron [None req-d74deba0-6180-4341-9550-fb08a33d3395 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] validate_networks() for [('f2ecf893-7204-4ed2-bd73-cc492f6006b2', None, None, None, None, None)] {{(pid=117679) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 10:33:23.818471 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-d74deba0-6180-4341-9550-fb08a33d3395 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Flavor limits 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 10:33:23.818997 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-d74deba0-6180-4341-9550-fb08a33d3395 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Image limits 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 10:33:23.819540 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-d74deba0-6180-4341-9550-fb08a33d3395 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Flavor pref 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 10:33:23.819981 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-d74deba0-6180-4341-9550-fb08a33d3395 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Image pref 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 10:33:23.820418 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-d74deba0-6180-4341-9550-fb08a33d3395 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 10:33:23.831169 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d74deba0-6180-4341-9550-fb08a33d3395 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:23.831528 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d74deba0-6180-4341-9550-fb08a33d3395 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:23.832599 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d74deba0-6180-4341-9550-fb08a33d3395 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:23.833040 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d74deba0-6180-4341-9550-fb08a33d3395 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:23.853681 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.quota [None req-d74deba0-6180-4341-9550-fb08a33d3395 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Getting quotas for project 0ead3712348245f8862718ef0e30b3c0. Resources: {'instances', 'cores', 'ram'} {{(pid=117679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:33:23.858382 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.quota [None req-d74deba0-6180-4341-9550-fb08a33d3395 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Getting quotas for user 172df9a596fd4729967f3787533ea57d and project 0ead3712348245f8862718ef0e30b3c0. Resources: {'instances', 'cores', 'ram'} {{(pid=117679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:33:23.870645 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-d74deba0-6180-4341-9550-fb08a33d3395 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Going to run 1 instances... {{(pid=117679) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 10:33:23.872903 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-d74deba0-6180-4341-9550-fb08a33d3395 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] [instance: d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7172d191-99fa-4494-b27e-c571f68b249d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 10:33:23.927906 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-d74deba0-6180-4341-9550-fb08a33d3395 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.783812 Jun 22 10:33:23.933370 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 480/982] 10.222.0.66 () {60 vars in 1146 bytes} [Wed Jun 22 10:33:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 22 10:33:23.945193 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-a9cc66b0-68eb-4b53-b870-96bece462a80 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:33:23.946239 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-a9cc66b0-68eb-4b53-b870-96bece462a80 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] [instance: d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:33:24.034552 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-a9cc66b0-68eb-4b53-b870-96bece462a80 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172df9a596fd4729967f3787533ea57d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ead3712348245f8862718ef0e30b3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:33:24.046621 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-a9cc66b0-68eb-4b53-b870-96bece462a80 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] 10.222.0.66 "GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f" status: 200 len: 1258 microversion: 2.1 time: 0.111077 Jun 22 10:33:24.047321 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 503/983] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:33:23 2022] GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f => generated 1258 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:33:24.469547 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-3f90342a-6722-4c12-9408-6c6a2536289d tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] Calling method '.version_select at 0x7f60da15c430>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:33:24.497443 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-3f90342a-6722-4c12-9408-6c6a2536289d tempest-TestVolumeBootPattern-1655045960 tempest-TestVolumeBootPattern-1655045960-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-666635953" status: 202 len: 0 microversion: 2.1 time: 0.032290 Jun 22 10:33:24.498874 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 481/984] 10.222.0.66 () {58 vars in 1259 bytes} [Wed Jun 22 10:33:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-666635953 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 22 10:33:25.070926 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-1c724b7f-262e-49ca-973c-65f89257b8b4 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:33:25.072869 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-1c724b7f-262e-49ca-973c-65f89257b8b4 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] [instance: d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:33:25.083933 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1c724b7f-262e-49ca-973c-65f89257b8b4 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:25.084741 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1c724b7f-262e-49ca-973c-65f89257b8b4 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:25.086381 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1c724b7f-262e-49ca-973c-65f89257b8b4 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:25.087372 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1c724b7f-262e-49ca-973c-65f89257b8b4 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:25.236415 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-1c724b7f-262e-49ca-973c-65f89257b8b4 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172df9a596fd4729967f3787533ea57d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ead3712348245f8862718ef0e30b3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:33:25.252369 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-1c724b7f-262e-49ca-973c-65f89257b8b4 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] 10.222.0.66 "GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f" status: 200 len: 1310 microversion: 2.1 time: 0.189249 Jun 22 10:33:25.253424 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 504/985] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:33:25 2022] GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f => generated 1310 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:33:26.281184 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-dfa307b8-1f8b-41d6-8e63-6e1459dd448b tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:33:26.281960 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-dfa307b8-1f8b-41d6-8e63-6e1459dd448b tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] [instance: d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:33:26.292881 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-dfa307b8-1f8b-41d6-8e63-6e1459dd448b tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:26.298638 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-dfa307b8-1f8b-41d6-8e63-6e1459dd448b tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:26.299672 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-dfa307b8-1f8b-41d6-8e63-6e1459dd448b tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:26.300228 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-dfa307b8-1f8b-41d6-8e63-6e1459dd448b tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:26.678912 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-dfa307b8-1f8b-41d6-8e63-6e1459dd448b tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172df9a596fd4729967f3787533ea57d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ead3712348245f8862718ef0e30b3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:33:26.690855 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-dfa307b8-1f8b-41d6-8e63-6e1459dd448b tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] 10.222.0.66 "GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f" status: 200 len: 1358 microversion: 2.1 time: 0.411903 Jun 22 10:33:26.691930 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 482/986] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:33:26 2022] GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f => generated 1358 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:33:27.715430 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-ba6aacbf-552c-4292-b32e-1f4dbe5e955f tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:33:27.716668 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-ba6aacbf-552c-4292-b32e-1f4dbe5e955f tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] [instance: d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:33:27.749879 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ba6aacbf-552c-4292-b32e-1f4dbe5e955f tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:27.753224 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ba6aacbf-552c-4292-b32e-1f4dbe5e955f tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:27.756276 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ba6aacbf-552c-4292-b32e-1f4dbe5e955f tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:27.758815 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ba6aacbf-552c-4292-b32e-1f4dbe5e955f tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:28.434646 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-ba6aacbf-552c-4292-b32e-1f4dbe5e955f tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172df9a596fd4729967f3787533ea57d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ead3712348245f8862718ef0e30b3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:33:28.445172 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-ba6aacbf-552c-4292-b32e-1f4dbe5e955f tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] 10.222.0.66 "GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f" status: 200 len: 1358 microversion: 2.1 time: 0.739418 Jun 22 10:33:28.456500 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 505/987] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:33:27 2022] GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f => generated 1358 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:33:28.706190 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-5957f321-6737-40ea-ad02-2b1596b2add5 req-87a1c011-0d61-449e-90e7-aad602008fea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f", "tag": "c74f0573-b6df-477d-baf7-505e6dbdf99f"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:33:28.745600 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-5957f321-6737-40ea-ad02-2b1596b2add5 req-87a1c011-0d61-449e-90e7-aad602008fea service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:28.746042 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-5957f321-6737-40ea-ad02-2b1596b2add5 req-87a1c011-0d61-449e-90e7-aad602008fea service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:28.765679 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-5957f321-6737-40ea-ad02-2b1596b2add5 req-87a1c011-0d61-449e-90e7-aad602008fea service nova] Creating event network-changed:c74f0573-b6df-477d-baf7-505e6dbdf99f for instance d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f on hv-cinder-84713 Jun 22 10:33:28.805483 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-5957f321-6737-40ea-ad02-2b1596b2add5 req-87a1c011-0d61-449e-90e7-aad602008fea service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115407 Jun 22 10:33:28.806911 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 483/988] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:33:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:33:29.470126 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-417a2b36-161e-4713-862f-1849e0631d9d tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:33:29.471304 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-417a2b36-161e-4713-862f-1849e0631d9d tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] [instance: d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:33:29.482352 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-417a2b36-161e-4713-862f-1849e0631d9d tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:29.484441 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-417a2b36-161e-4713-862f-1849e0631d9d tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:29.486378 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-417a2b36-161e-4713-862f-1849e0631d9d tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:29.487645 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-417a2b36-161e-4713-862f-1849e0631d9d tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:30.131761 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-417a2b36-161e-4713-862f-1849e0631d9d tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172df9a596fd4729967f3787533ea57d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ead3712348245f8862718ef0e30b3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:33:30.163669 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-417a2b36-161e-4713-862f-1849e0631d9d tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] 10.222.0.66 "GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f" status: 200 len: 1358 microversion: 2.1 time: 0.694337 Jun 22 10:33:30.184735 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 506/989] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:33:29 2022] GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f => generated 1358 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:33:31.190541 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-202cb7c6-bc4b-497d-af5f-9afc18fb48ea tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:33:31.191947 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-202cb7c6-bc4b-497d-af5f-9afc18fb48ea tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] [instance: d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:33:31.206233 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-202cb7c6-bc4b-497d-af5f-9afc18fb48ea tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:31.207681 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-202cb7c6-bc4b-497d-af5f-9afc18fb48ea tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:31.211208 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-202cb7c6-bc4b-497d-af5f-9afc18fb48ea tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:31.211931 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-202cb7c6-bc4b-497d-af5f-9afc18fb48ea tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:31.894230 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-202cb7c6-bc4b-497d-af5f-9afc18fb48ea tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172df9a596fd4729967f3787533ea57d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ead3712348245f8862718ef0e30b3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:33:31.972770 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-202cb7c6-bc4b-497d-af5f-9afc18fb48ea tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] 10.222.0.66 "GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f" status: 200 len: 1358 microversion: 2.1 time: 0.785516 Jun 22 10:33:31.974001 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 484/990] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:33:31 2022] GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f => generated 1358 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:33:33.003343 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-f8db664d-4df9-4ddb-9b0b-d579c21bf1d2 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:33:33.004147 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-f8db664d-4df9-4ddb-9b0b-d579c21bf1d2 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] [instance: d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:33:33.024413 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f8db664d-4df9-4ddb-9b0b-d579c21bf1d2 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:33.027298 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f8db664d-4df9-4ddb-9b0b-d579c21bf1d2 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:33.031457 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f8db664d-4df9-4ddb-9b0b-d579c21bf1d2 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:33.033261 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f8db664d-4df9-4ddb-9b0b-d579c21bf1d2 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:33.663693 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-f8db664d-4df9-4ddb-9b0b-d579c21bf1d2 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172df9a596fd4729967f3787533ea57d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ead3712348245f8862718ef0e30b3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:33:33.683923 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-f8db664d-4df9-4ddb-9b0b-d579c21bf1d2 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] 10.222.0.66 "GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f" status: 200 len: 1358 microversion: 2.1 time: 0.687425 Jun 22 10:33:33.696845 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 507/991] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:33:32 2022] GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f => generated 1358 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:33:34.715913 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-4551ebd6-e742-4190-9521-0c8fc1af519e tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:33:34.718434 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-4551ebd6-e742-4190-9521-0c8fc1af519e tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] [instance: d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:33:34.750120 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_cell0:SELECT=2 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:34.753425 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_cell0:SELECT=6 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:34.759772 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4551ebd6-e742-4190-9521-0c8fc1af519e tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:34.766247 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4551ebd6-e742-4190-9521-0c8fc1af519e tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:34.768156 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4551ebd6-e742-4190-9521-0c8fc1af519e tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:34.773460 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4551ebd6-e742-4190-9521-0c8fc1af519e tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:35.287755 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-4551ebd6-e742-4190-9521-0c8fc1af519e tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172df9a596fd4729967f3787533ea57d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ead3712348245f8862718ef0e30b3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:33:35.297603 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-4551ebd6-e742-4190-9521-0c8fc1af519e tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] 10.222.0.66 "GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f" status: 200 len: 1358 microversion: 2.1 time: 0.588890 Jun 22 10:33:35.304561 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 485/992] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:33:34 2022] GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f => generated 1358 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:33:36.337361 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-78e68582-9e2d-473b-9553-4ef239ba38ee tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:33:36.338615 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-78e68582-9e2d-473b-9553-4ef239ba38ee tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] [instance: d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:33:36.348829 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell0:SELECT=6 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:36.358351 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:36.385717 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-78e68582-9e2d-473b-9553-4ef239ba38ee tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:36.386188 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-78e68582-9e2d-473b-9553-4ef239ba38ee tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:36.388515 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-78e68582-9e2d-473b-9553-4ef239ba38ee tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:36.391720 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-78e68582-9e2d-473b-9553-4ef239ba38ee tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:36.416803 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:SELECT=54 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:36.694331 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-78e68582-9e2d-473b-9553-4ef239ba38ee tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172df9a596fd4729967f3787533ea57d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ead3712348245f8862718ef0e30b3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:33:36.710251 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-78e68582-9e2d-473b-9553-4ef239ba38ee tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] 10.222.0.66 "GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f" status: 200 len: 1358 microversion: 2.1 time: 0.379624 Jun 22 10:33:36.720336 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 508/993] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:33:36 2022] GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f => generated 1358 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:33:37.731775 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-d7fa32e8-f1b4-499c-8824-ec6d17496100 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:33:37.732957 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-d7fa32e8-f1b4-499c-8824-ec6d17496100 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] [instance: d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:33:37.760285 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:37.772288 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d7fa32e8-f1b4-499c-8824-ec6d17496100 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:37.772764 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d7fa32e8-f1b4-499c-8824-ec6d17496100 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:37.773620 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d7fa32e8-f1b4-499c-8824-ec6d17496100 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:37.774131 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d7fa32e8-f1b4-499c-8824-ec6d17496100 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:37.819612 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:33:38.733398 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-d7fa32e8-f1b4-499c-8824-ec6d17496100 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172df9a596fd4729967f3787533ea57d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ead3712348245f8862718ef0e30b3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:33:38.752563 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-d7fa32e8-f1b4-499c-8824-ec6d17496100 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] 10.222.0.66 "GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f" status: 200 len: 1358 microversion: 2.1 time: 1.028830 Jun 22 10:33:38.767477 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 486/994] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:33:37 2022] GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f => generated 1358 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:33:39.783956 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-90f39dc8-927e-46a1-89da-5505766eed1c tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:33:39.785476 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-90f39dc8-927e-46a1-89da-5505766eed1c tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] [instance: d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:33:39.793685 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-90f39dc8-927e-46a1-89da-5505766eed1c tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:39.794536 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-90f39dc8-927e-46a1-89da-5505766eed1c tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:39.795627 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-90f39dc8-927e-46a1-89da-5505766eed1c tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:39.796438 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-90f39dc8-927e-46a1-89da-5505766eed1c tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:40.032595 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-90f39dc8-927e-46a1-89da-5505766eed1c tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172df9a596fd4729967f3787533ea57d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ead3712348245f8862718ef0e30b3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:33:40.043750 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-90f39dc8-927e-46a1-89da-5505766eed1c tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] 10.222.0.66 "GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f" status: 200 len: 1358 microversion: 2.1 time: 0.263770 Jun 22 10:33:40.058275 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 509/995] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:33:39 2022] GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f => generated 1358 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:33:41.060842 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-c4a3f0d6-380d-4c85-911b-1fe81a320398 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:33:41.062306 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-c4a3f0d6-380d-4c85-911b-1fe81a320398 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] [instance: d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:33:41.070393 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c4a3f0d6-380d-4c85-911b-1fe81a320398 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:41.071368 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c4a3f0d6-380d-4c85-911b-1fe81a320398 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:41.072580 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c4a3f0d6-380d-4c85-911b-1fe81a320398 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:41.073267 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-c4a3f0d6-380d-4c85-911b-1fe81a320398 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:41.387411 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-c4a3f0d6-380d-4c85-911b-1fe81a320398 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172df9a596fd4729967f3787533ea57d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ead3712348245f8862718ef0e30b3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:33:41.400941 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-c4a3f0d6-380d-4c85-911b-1fe81a320398 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] 10.222.0.66 "GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f" status: 200 len: 1358 microversion: 2.1 time: 0.344071 Jun 22 10:33:41.401705 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 487/996] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:33:41 2022] GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f => generated 1358 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:33:42.427021 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-5bb3fda1-0d68-4c78-b882-e2b868c151fa tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:33:42.428077 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-5bb3fda1-0d68-4c78-b882-e2b868c151fa tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] [instance: d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:33:42.438116 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5bb3fda1-0d68-4c78-b882-e2b868c151fa tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:42.438871 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5bb3fda1-0d68-4c78-b882-e2b868c151fa tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:42.447358 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5bb3fda1-0d68-4c78-b882-e2b868c151fa tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:42.448104 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5bb3fda1-0d68-4c78-b882-e2b868c151fa tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:42.630732 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-5bb3fda1-0d68-4c78-b882-e2b868c151fa tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172df9a596fd4729967f3787533ea57d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ead3712348245f8862718ef0e30b3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:33:42.652277 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-5bb3fda1-0d68-4c78-b882-e2b868c151fa tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] 10.222.0.66 "GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f" status: 200 len: 1358 microversion: 2.1 time: 0.231174 Jun 22 10:33:42.655264 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 510/997] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:33:42 2022] GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f => generated 1358 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:33:43.697112 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-148c995c-41b7-4a11-a915-e1a3bf4444ea tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:33:43.699399 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-148c995c-41b7-4a11-a915-e1a3bf4444ea tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] [instance: d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:33:43.713552 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-148c995c-41b7-4a11-a915-e1a3bf4444ea tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:43.714773 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-148c995c-41b7-4a11-a915-e1a3bf4444ea tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:43.716447 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-148c995c-41b7-4a11-a915-e1a3bf4444ea tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:43.718187 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-148c995c-41b7-4a11-a915-e1a3bf4444ea tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:43.902073 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-148c995c-41b7-4a11-a915-e1a3bf4444ea tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172df9a596fd4729967f3787533ea57d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ead3712348245f8862718ef0e30b3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:33:43.916954 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-148c995c-41b7-4a11-a915-e1a3bf4444ea tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] 10.222.0.66 "GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f" status: 200 len: 1358 microversion: 2.1 time: 0.237121 Jun 22 10:33:43.919151 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 488/998] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:33:43 2022] GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f => generated 1358 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:33:44.936566 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-cd12e422-daf1-4702-b996-aacd08456ddd tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:33:44.937445 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-cd12e422-daf1-4702-b996-aacd08456ddd tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] [instance: d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:33:44.947481 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-cd12e422-daf1-4702-b996-aacd08456ddd tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:44.948878 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-cd12e422-daf1-4702-b996-aacd08456ddd tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:44.950827 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-cd12e422-daf1-4702-b996-aacd08456ddd tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:44.951907 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-cd12e422-daf1-4702-b996-aacd08456ddd tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:45.164827 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-cd12e422-daf1-4702-b996-aacd08456ddd tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172df9a596fd4729967f3787533ea57d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ead3712348245f8862718ef0e30b3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:33:45.174288 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-cd12e422-daf1-4702-b996-aacd08456ddd tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] 10.222.0.66 "GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f" status: 200 len: 1358 microversion: 2.1 time: 0.241581 Jun 22 10:33:45.174916 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 511/999] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:33:44 2022] GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f => generated 1358 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:33:46.195819 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-abc43b5c-d1d5-42fa-bc76-7938f13c5e6b tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:33:46.197007 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-abc43b5c-d1d5-42fa-bc76-7938f13c5e6b tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] [instance: d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:33:46.210240 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-abc43b5c-d1d5-42fa-bc76-7938f13c5e6b tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:46.211036 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-abc43b5c-d1d5-42fa-bc76-7938f13c5e6b tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:46.212715 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-abc43b5c-d1d5-42fa-bc76-7938f13c5e6b tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:46.213718 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-abc43b5c-d1d5-42fa-bc76-7938f13c5e6b tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:46.438031 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-abc43b5c-d1d5-42fa-bc76-7938f13c5e6b tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172df9a596fd4729967f3787533ea57d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ead3712348245f8862718ef0e30b3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:33:46.451995 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-abc43b5c-d1d5-42fa-bc76-7938f13c5e6b tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] 10.222.0.66 "GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f" status: 200 len: 1358 microversion: 2.1 time: 0.263692 Jun 22 10:33:46.453461 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 489/1000] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:33:46 2022] GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f => generated 1358 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:33:47.474960 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-075ada53-dd36-4b99-9c54-299ba6357543 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:33:47.476065 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-075ada53-dd36-4b99-9c54-299ba6357543 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] [instance: d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:33:47.492192 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-075ada53-dd36-4b99-9c54-299ba6357543 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:47.493177 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-075ada53-dd36-4b99-9c54-299ba6357543 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:47.494545 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-075ada53-dd36-4b99-9c54-299ba6357543 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:47.495427 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-075ada53-dd36-4b99-9c54-299ba6357543 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:47.736912 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-e684715a-b90d-4ec9-814d-d8d27e855144 req-44746cb2-d67b-448d-b289-c349a5854b5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f", "name": "network-vif-plugged", "status": "completed", "tag": "c74f0573-b6df-477d-baf7-505e6dbdf99f"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:33:47.756620 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-e684715a-b90d-4ec9-814d-d8d27e855144 req-44746cb2-d67b-448d-b289-c349a5854b5a service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:47.756620 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-e684715a-b90d-4ec9-814d-d8d27e855144 req-44746cb2-d67b-448d-b289-c349a5854b5a service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:47.780198 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-e684715a-b90d-4ec9-814d-d8d27e855144 req-44746cb2-d67b-448d-b289-c349a5854b5a service nova] Creating event network-vif-plugged:c74f0573-b6df-477d-baf7-505e6dbdf99f for instance d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f on hv-cinder-84713 Jun 22 10:33:47.793123 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-e684715a-b90d-4ec9-814d-d8d27e855144 req-44746cb2-d67b-448d-b289-c349a5854b5a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059814 Jun 22 10:33:47.793757 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 490/1001] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:33:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:33:47.847397 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-075ada53-dd36-4b99-9c54-299ba6357543 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172df9a596fd4729967f3787533ea57d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ead3712348245f8862718ef0e30b3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:33:47.881757 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-075ada53-dd36-4b99-9c54-299ba6357543 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] 10.222.0.66 "GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f" status: 200 len: 1358 microversion: 2.1 time: 0.415013 Jun 22 10:33:47.889718 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 512/1002] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:33:47 2022] GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f => generated 1358 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:33:48.914893 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-d60f794b-fd0b-42f4-b88f-7a37daa9d672 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:33:48.915808 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-d60f794b-fd0b-42f4-b88f-7a37daa9d672 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] [instance: d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:33:48.922982 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d60f794b-fd0b-42f4-b88f-7a37daa9d672 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:48.923428 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d60f794b-fd0b-42f4-b88f-7a37daa9d672 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:48.924222 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d60f794b-fd0b-42f4-b88f-7a37daa9d672 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:48.924668 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d60f794b-fd0b-42f4-b88f-7a37daa9d672 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:49.144206 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-d60f794b-fd0b-42f4-b88f-7a37daa9d672 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172df9a596fd4729967f3787533ea57d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ead3712348245f8862718ef0e30b3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:33:49.155395 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-d60f794b-fd0b-42f4-b88f-7a37daa9d672 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] 10.222.0.66 "GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f" status: 200 len: 1358 microversion: 2.1 time: 0.245237 Jun 22 10:33:49.156402 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 491/1003] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:33:48 2022] GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f => generated 1358 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:33:50.182096 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-14d8d501-2020-4c20-879b-2cb225ecd9bc tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:33:50.183312 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-14d8d501-2020-4c20-879b-2cb225ecd9bc tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] [instance: d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:33:50.195376 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-14d8d501-2020-4c20-879b-2cb225ecd9bc tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:50.196143 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-14d8d501-2020-4c20-879b-2cb225ecd9bc tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:50.197274 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-14d8d501-2020-4c20-879b-2cb225ecd9bc tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:50.198054 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-14d8d501-2020-4c20-879b-2cb225ecd9bc tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:50.431794 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-14d8d501-2020-4c20-879b-2cb225ecd9bc tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172df9a596fd4729967f3787533ea57d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ead3712348245f8862718ef0e30b3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:33:50.441824 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-14d8d501-2020-4c20-879b-2cb225ecd9bc tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] 10.222.0.66 "GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f" status: 200 len: 1547 microversion: 2.1 time: 0.266652 Jun 22 10:33:50.443242 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 513/1004] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:33:50 2022] GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f => generated 1547 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:33:50.464380 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-8e06046e-7c2b-4245-a49e-3f8f45979ce9 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:33:50.465356 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-8e06046e-7c2b-4245-a49e-3f8f45979ce9 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] [instance: d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:33:50.474442 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8e06046e-7c2b-4245-a49e-3f8f45979ce9 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:50.475287 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8e06046e-7c2b-4245-a49e-3f8f45979ce9 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:50.476612 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8e06046e-7c2b-4245-a49e-3f8f45979ce9 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:50.477350 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8e06046e-7c2b-4245-a49e-3f8f45979ce9 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:50.705232 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-8e06046e-7c2b-4245-a49e-3f8f45979ce9 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172df9a596fd4729967f3787533ea57d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ead3712348245f8862718ef0e30b3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:33:50.723861 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-8e06046e-7c2b-4245-a49e-3f8f45979ce9 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] 10.222.0.66 "GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f" status: 200 len: 1547 microversion: 2.1 time: 0.265660 Jun 22 10:33:50.725860 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 492/1005] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:33:50 2022] GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f => generated 1547 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:33:50.747661 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-f945bf20-0f7f-40bb-9543-e84f5a2bdcc5 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:33:50.754376 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-f945bf20-0f7f-40bb-9543-e84f5a2bdcc5 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '172df9a596fd4729967f3787533ea57d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ead3712348245f8862718ef0e30b3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:33:50.756112 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-f945bf20-0f7f-40bb-9543-e84f5a2bdcc5 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Searching by: {'deleted': False, 'project_id': '0ead3712348245f8862718ef0e30b3c0'} {{(pid=117680) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 22 10:33:50.771599 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f945bf20-0f7f-40bb-9543-e84f5a2bdcc5 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:50.772673 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f945bf20-0f7f-40bb-9543-e84f5a2bdcc5 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:50.774703 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f945bf20-0f7f-40bb-9543-e84f5a2bdcc5 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:50.775528 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f945bf20-0f7f-40bb-9543-e84f5a2bdcc5 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:50.949855 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.multi_cell_list [None req-f945bf20-0f7f-40bb-9543-e84f5a2bdcc5 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117680) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 22 10:33:51.115809 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-f945bf20-0f7f-40bb-9543-e84f5a2bdcc5 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] 10.222.0.66 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.372490 Jun 22 10:33:51.116493 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 514/1006] 10.222.0.66 () {58 vars in 1124 bytes} [Wed Jun 22 10:33:50 2022] GET /compute/v2.1/servers => generated 343 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:33:51.130950 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-0a69b46a-0bb3-44f9-ab94-1928ce0c4518 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:33:51.132046 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-0a69b46a-0bb3-44f9-ab94-1928ce0c4518 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] [instance: d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:33:51.141369 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0a69b46a-0bb3-44f9-ab94-1928ce0c4518 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:51.142055 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0a69b46a-0bb3-44f9-ab94-1928ce0c4518 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:51.143291 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0a69b46a-0bb3-44f9-ab94-1928ce0c4518 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:51.143880 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0a69b46a-0bb3-44f9-ab94-1928ce0c4518 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:51.345885 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-0a69b46a-0bb3-44f9-ab94-1928ce0c4518 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172df9a596fd4729967f3787533ea57d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ead3712348245f8862718ef0e30b3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:33:51.360915 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-0a69b46a-0bb3-44f9-ab94-1928ce0c4518 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] 10.222.0.66 "GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f" status: 200 len: 1547 microversion: 2.1 time: 0.236561 Jun 22 10:33:51.362604 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 493/1007] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:33:51 2022] GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f => generated 1547 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:33:54.451815 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-3d9ca333-12a6-4713-9740-33fc3ee2d463 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "af13d548-164b-46a8-a609-9c7b27bd2a60"}} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:33:54.453225 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-3d9ca333-12a6-4713-9740-33fc3ee2d463 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] [instance: d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:33:54.463966 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3d9ca333-12a6-4713-9740-33fc3ee2d463 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:54.464784 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3d9ca333-12a6-4713-9740-33fc3ee2d463 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:54.466178 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3d9ca333-12a6-4713-9740-33fc3ee2d463 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:33:54.467243 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3d9ca333-12a6-4713-9740-33fc3ee2d463 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:33:54.825957 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-3d9ca333-12a6-4713-9740-33fc3ee2d463 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] 10.222.0.66 "POST /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.379635 Jun 22 10:33:54.827802 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 515/1008] 10.222.0.66 () {60 vars in 1322 bytes} [Wed Jun 22 10:33:54 2022] POST /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f/os-volume_attachments => generated 194 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:34:06.902263 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-4b4a5066-8b52-4c5b-9627-2bc1a59bb5ed tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:34:06.903530 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-4b4a5066-8b52-4c5b-9627-2bc1a59bb5ed tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] [instance: d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:34:06.906619 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_api:SELECT=15 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:34:06.907334 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_cell1:SELECT=43 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:34:06.914283 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4b4a5066-8b52-4c5b-9627-2bc1a59bb5ed tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:06.914774 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4b4a5066-8b52-4c5b-9627-2bc1a59bb5ed tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:06.915586 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4b4a5066-8b52-4c5b-9627-2bc1a59bb5ed tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:06.916025 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4b4a5066-8b52-4c5b-9627-2bc1a59bb5ed tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:07.081551 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-4b4a5066-8b52-4c5b-9627-2bc1a59bb5ed tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172df9a596fd4729967f3787533ea57d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ead3712348245f8862718ef0e30b3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:34:07.092194 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-4b4a5066-8b52-4c5b-9627-2bc1a59bb5ed tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] 10.222.0.66 "GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f" status: 200 len: 1593 microversion: 2.1 time: 0.194155 Jun 22 10:34:07.093091 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 494/1009] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:34:06 2022] GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f => generated 1593 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:34:09.494736 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell0:SELECT=2 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:34:09.495982 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_api:SELECT=15 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:34:09.496865 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:34:09.502252 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-53f84f16-8398-43c1-be3a-9c904878913f req-c1cd3f57-1ead-44a5-a286-4a9aa09ec6e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f", "tag": "c74f0573-b6df-477d-baf7-505e6dbdf99f"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:34:09.515374 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-53f84f16-8398-43c1-be3a-9c904878913f req-c1cd3f57-1ead-44a5-a286-4a9aa09ec6e5 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:09.516181 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-53f84f16-8398-43c1-be3a-9c904878913f req-c1cd3f57-1ead-44a5-a286-4a9aa09ec6e5 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:09.532788 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-53f84f16-8398-43c1-be3a-9c904878913f req-c1cd3f57-1ead-44a5-a286-4a9aa09ec6e5 service nova] Creating event network-changed:c74f0573-b6df-477d-baf7-505e6dbdf99f for instance d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f on hv-cinder-84713 Jun 22 10:34:09.539682 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-53f84f16-8398-43c1-be3a-9c904878913f req-c1cd3f57-1ead-44a5-a286-4a9aa09ec6e5 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046207 Jun 22 10:34:09.541103 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 516/1010] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:34:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:34:11.241106 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-6ec3513e-9c0e-455c-b75f-e1e0b5d8a404 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1139371714"}} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:34:11.241742 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-6ec3513e-9c0e-455c-b75f-e1e0b5d8a404 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] [instance: d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:34:11.248266 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6ec3513e-9c0e-455c-b75f-e1e0b5d8a404 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:11.248721 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6ec3513e-9c0e-455c-b75f-e1e0b5d8a404 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:11.249505 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6ec3513e-9c0e-455c-b75f-e1e0b5d8a404 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:11.249944 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6ec3513e-9c0e-455c-b75f-e1e0b5d8a404 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:11.401064 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.network.security_group_api [None req-6ec3513e-9c0e-455c-b75f-e1e0b5d8a404 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Adding security group ae9bcece-751c-4f67-b425-7dd2601c7610 to port c74f0573-b6df-477d-baf7-505e6dbdf99f Jun 22 10:34:11.882297 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-6ec3513e-9c0e-455c-b75f-e1e0b5d8a404 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] 10.222.0.66 "POST /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f/action" status: 202 len: 0 microversion: 2.1 time: 0.645421 Jun 22 10:34:11.894640 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-a3326d28-8152-4203-9e26-96c532bc9ba5 req-c3c69a2d-6d1b-45a4-8325-06a38f196738 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f", "tag": "c74f0573-b6df-477d-baf7-505e6dbdf99f"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:34:11.897580 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 495/1011] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Jun 22 10:34:11 2022] POST /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f/action => generated 0 bytes in 664 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:34:11.936189 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-4d40143b-68d9-452f-ba8b-0e86ce7fe69f tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:34:11.940481 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-4d40143b-68d9-452f-ba8b-0e86ce7fe69f tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] [instance: d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:34:11.950894 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-a3326d28-8152-4203-9e26-96c532bc9ba5 req-c3c69a2d-6d1b-45a4-8325-06a38f196738 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:11.952821 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-a3326d28-8152-4203-9e26-96c532bc9ba5 req-c3c69a2d-6d1b-45a4-8325-06a38f196738 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:11.972207 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4d40143b-68d9-452f-ba8b-0e86ce7fe69f tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:11.972706 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4d40143b-68d9-452f-ba8b-0e86ce7fe69f tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:11.973600 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4d40143b-68d9-452f-ba8b-0e86ce7fe69f tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:11.974032 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4d40143b-68d9-452f-ba8b-0e86ce7fe69f tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:11.990544 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-a3326d28-8152-4203-9e26-96c532bc9ba5 req-c3c69a2d-6d1b-45a4-8325-06a38f196738 service nova] Creating event network-changed:c74f0573-b6df-477d-baf7-505e6dbdf99f for instance d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f on hv-cinder-84713 Jun 22 10:34:11.996448 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-a3326d28-8152-4203-9e26-96c532bc9ba5 req-c3c69a2d-6d1b-45a4-8325-06a38f196738 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107477 Jun 22 10:34:11.997890 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 517/1012] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:34:12.234746 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-4d40143b-68d9-452f-ba8b-0e86ce7fe69f tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172df9a596fd4729967f3787533ea57d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ead3712348245f8862718ef0e30b3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:34:12.248267 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-4d40143b-68d9-452f-ba8b-0e86ce7fe69f tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] 10.222.0.66 "GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f" status: 200 len: 1757 microversion: 2.1 time: 0.337318 Jun 22 10:34:12.249329 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 496/1013] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:34:11 2022] GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f => generated 1757 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:34:46.439732 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-3c95f620-9d8e-450f-b90b-a5b4145c254e tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1880487131", "imageRef": "58addf50-5317-403a-beb0-4760bdbcaa13", "flavorRef": "452", "networks": [{"uuid": "00a21b97-a81a-4bf7-9dd7-0f9803d9bdb7"}]}} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:34:46.447766 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_api:SELECT=4 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:34:46.448413 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:SELECT=4 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:34:46.508946 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.network.neutron [None req-3c95f620-9d8e-450f-b90b-a5b4145c254e tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] validate_networks() for [('00a21b97-a81a-4bf7-9dd7-0f9803d9bdb7', None, None, None, None, None)] {{(pid=117680) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 10:34:47.276175 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-3c95f620-9d8e-450f-b90b-a5b4145c254e tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Flavor limits 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 10:34:47.276797 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-3c95f620-9d8e-450f-b90b-a5b4145c254e tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Image limits 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 10:34:47.277478 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-3c95f620-9d8e-450f-b90b-a5b4145c254e tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Flavor pref 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 10:34:47.278574 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-3c95f620-9d8e-450f-b90b-a5b4145c254e tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Image pref 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 10:34:47.279157 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-3c95f620-9d8e-450f-b90b-a5b4145c254e tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 10:34:47.289575 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3c95f620-9d8e-450f-b90b-a5b4145c254e tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:47.290027 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3c95f620-9d8e-450f-b90b-a5b4145c254e tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:47.290877 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3c95f620-9d8e-450f-b90b-a5b4145c254e tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:47.291324 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3c95f620-9d8e-450f-b90b-a5b4145c254e tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:47.309946 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.quota [None req-3c95f620-9d8e-450f-b90b-a5b4145c254e tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Getting quotas for project cc445d96f85d4cf49747bf592ad9d26b. Resources: {'instances', 'cores', 'ram'} {{(pid=117680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:34:47.314756 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.quota [None req-3c95f620-9d8e-450f-b90b-a5b4145c254e tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Getting quotas for user 004ddfdfeb7f4151bc84f166638123e4 and project cc445d96f85d4cf49747bf592ad9d26b. Resources: {'instances', 'cores', 'ram'} {{(pid=117680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:34:47.327697 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-3c95f620-9d8e-450f-b90b-a5b4145c254e tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Going to run 1 instances... {{(pid=117680) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 10:34:47.330295 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-3c95f620-9d8e-450f-b90b-a5b4145c254e tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] [instance: b324d2b4-4aa5-49a6-b530-35d9f3bc1a53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58addf50-5317-403a-beb0-4760bdbcaa13',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 10:34:47.379560 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-3c95f620-9d8e-450f-b90b-a5b4145c254e tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.944268 Jun 22 10:34:47.380221 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 518/1014] 10.222.0.66 () {60 vars in 1146 bytes} [Wed Jun 22 10:34:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 946 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 10:34:47.391078 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-3a05f5c8-8379-4b7a-b2cd-c162183df353 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:34:47.391869 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-3a05f5c8-8379-4b7a-b2cd-c162183df353 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] [instance: b324d2b4-4aa5-49a6-b530-35d9f3bc1a53] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:34:47.393910 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_api:SELECT=6 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:34:47.394599 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_cell1:SELECT=16 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:34:47.476662 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-3a05f5c8-8379-4b7a-b2cd-c162183df353 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ddfdfeb7f4151bc84f166638123e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc445d96f85d4cf49747bf592ad9d26b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:34:47.484664 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-3a05f5c8-8379-4b7a-b2cd-c162183df353 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] 10.222.0.66 "GET /compute/v2.1/servers/b324d2b4-4aa5-49a6-b530-35d9f3bc1a53" status: 200 len: 1219 microversion: 2.1 time: 0.097401 Jun 22 10:34:47.493701 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 497/1015] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:34:47 2022] GET /compute/v2.1/servers/b324d2b4-4aa5-49a6-b530-35d9f3bc1a53 => generated 1219 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:34:48.509978 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-83db26a8-5d8a-40f0-92ce-f37d2864b176 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:34:48.511162 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-83db26a8-5d8a-40f0-92ce-f37d2864b176 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] [instance: b324d2b4-4aa5-49a6-b530-35d9f3bc1a53] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:34:48.525000 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-83db26a8-5d8a-40f0-92ce-f37d2864b176 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:48.525822 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-83db26a8-5d8a-40f0-92ce-f37d2864b176 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:48.527574 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-83db26a8-5d8a-40f0-92ce-f37d2864b176 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:48.528875 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-83db26a8-5d8a-40f0-92ce-f37d2864b176 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:48.671008 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-83db26a8-5d8a-40f0-92ce-f37d2864b176 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ddfdfeb7f4151bc84f166638123e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc445d96f85d4cf49747bf592ad9d26b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:34:48.687636 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-83db26a8-5d8a-40f0-92ce-f37d2864b176 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] 10.222.0.66 "GET /compute/v2.1/servers/b324d2b4-4aa5-49a6-b530-35d9f3bc1a53" status: 200 len: 1279 microversion: 2.1 time: 0.187121 Jun 22 10:34:48.688952 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 519/1016] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:34:48 2022] GET /compute/v2.1/servers/b324d2b4-4aa5-49a6-b530-35d9f3bc1a53 => generated 1279 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:34:49.708267 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-a533eef3-bcd6-4d46-91e6-f0b428114e57 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:34:49.709389 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-a533eef3-bcd6-4d46-91e6-f0b428114e57 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] [instance: b324d2b4-4aa5-49a6-b530-35d9f3bc1a53] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:34:49.720103 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a533eef3-bcd6-4d46-91e6-f0b428114e57 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:49.720568 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a533eef3-bcd6-4d46-91e6-f0b428114e57 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:49.721418 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a533eef3-bcd6-4d46-91e6-f0b428114e57 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:49.721852 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-a533eef3-bcd6-4d46-91e6-f0b428114e57 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:49.893951 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-a533eef3-bcd6-4d46-91e6-f0b428114e57 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ddfdfeb7f4151bc84f166638123e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc445d96f85d4cf49747bf592ad9d26b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:34:49.902420 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-a533eef3-bcd6-4d46-91e6-f0b428114e57 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] 10.222.0.66 "GET /compute/v2.1/servers/b324d2b4-4aa5-49a6-b530-35d9f3bc1a53" status: 200 len: 1319 microversion: 2.1 time: 0.198919 Jun 22 10:34:49.903543 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 498/1017] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:34:49 2022] GET /compute/v2.1/servers/b324d2b4-4aa5-49a6-b530-35d9f3bc1a53 => generated 1319 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:34:50.407960 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-67b9db7e-c10d-44a9-b285-60a396f68ffb req-1f567216-d491-4fb2-a046-462072f41893 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b324d2b4-4aa5-49a6-b530-35d9f3bc1a53", "tag": "a6e39273-efd0-4b88-85de-21b8091fe0ce"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:34:50.424494 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-67b9db7e-c10d-44a9-b285-60a396f68ffb req-1f567216-d491-4fb2-a046-462072f41893 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:50.425603 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-67b9db7e-c10d-44a9-b285-60a396f68ffb req-1f567216-d491-4fb2-a046-462072f41893 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:50.447424 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-67b9db7e-c10d-44a9-b285-60a396f68ffb req-1f567216-d491-4fb2-a046-462072f41893 service nova] Creating event network-changed:a6e39273-efd0-4b88-85de-21b8091fe0ce for instance b324d2b4-4aa5-49a6-b530-35d9f3bc1a53 on hv-cinder-84713 Jun 22 10:34:50.456828 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-67b9db7e-c10d-44a9-b285-60a396f68ffb req-1f567216-d491-4fb2-a046-462072f41893 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057799 Jun 22 10:34:50.457947 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 520/1018] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:34:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:34:50.924070 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-851db2f7-f9b6-4a94-bce1-27df450ca3bd tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:34:50.924687 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-851db2f7-f9b6-4a94-bce1-27df450ca3bd tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] [instance: b324d2b4-4aa5-49a6-b530-35d9f3bc1a53] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:34:50.932234 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-851db2f7-f9b6-4a94-bce1-27df450ca3bd tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:50.932732 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-851db2f7-f9b6-4a94-bce1-27df450ca3bd tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:50.933735 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-851db2f7-f9b6-4a94-bce1-27df450ca3bd tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:50.934234 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-851db2f7-f9b6-4a94-bce1-27df450ca3bd tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:51.110027 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-851db2f7-f9b6-4a94-bce1-27df450ca3bd tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ddfdfeb7f4151bc84f166638123e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc445d96f85d4cf49747bf592ad9d26b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:34:51.123818 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-851db2f7-f9b6-4a94-bce1-27df450ca3bd tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] 10.222.0.66 "GET /compute/v2.1/servers/b324d2b4-4aa5-49a6-b530-35d9f3bc1a53" status: 200 len: 1319 microversion: 2.1 time: 0.204137 Jun 22 10:34:51.124849 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 499/1019] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:34:50 2022] GET /compute/v2.1/servers/b324d2b4-4aa5-49a6-b530-35d9f3bc1a53 => generated 1319 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:34:52.150223 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-d4bf483d-c70f-487b-b0d0-ae2d7b7eb847 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:34:52.151096 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-d4bf483d-c70f-487b-b0d0-ae2d7b7eb847 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] [instance: b324d2b4-4aa5-49a6-b530-35d9f3bc1a53] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:34:52.161575 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d4bf483d-c70f-487b-b0d0-ae2d7b7eb847 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:52.162230 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d4bf483d-c70f-487b-b0d0-ae2d7b7eb847 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:52.163673 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d4bf483d-c70f-487b-b0d0-ae2d7b7eb847 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:52.164429 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d4bf483d-c70f-487b-b0d0-ae2d7b7eb847 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:52.317629 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-d4bf483d-c70f-487b-b0d0-ae2d7b7eb847 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ddfdfeb7f4151bc84f166638123e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc445d96f85d4cf49747bf592ad9d26b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:34:52.327334 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-d4bf483d-c70f-487b-b0d0-ae2d7b7eb847 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] 10.222.0.66 "GET /compute/v2.1/servers/b324d2b4-4aa5-49a6-b530-35d9f3bc1a53" status: 200 len: 1319 microversion: 2.1 time: 0.181888 Jun 22 10:34:52.327951 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 521/1020] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:34:52 2022] GET /compute/v2.1/servers/b324d2b4-4aa5-49a6-b530-35d9f3bc1a53 => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:34:53.354433 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-6e13e03c-0744-45ed-bfd0-fe672882d7e7 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:34:53.355643 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-6e13e03c-0744-45ed-bfd0-fe672882d7e7 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] [instance: b324d2b4-4aa5-49a6-b530-35d9f3bc1a53] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:34:53.365021 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6e13e03c-0744-45ed-bfd0-fe672882d7e7 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:53.365813 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6e13e03c-0744-45ed-bfd0-fe672882d7e7 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:53.367309 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6e13e03c-0744-45ed-bfd0-fe672882d7e7 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:53.367945 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6e13e03c-0744-45ed-bfd0-fe672882d7e7 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:53.613538 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-6e13e03c-0744-45ed-bfd0-fe672882d7e7 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ddfdfeb7f4151bc84f166638123e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc445d96f85d4cf49747bf592ad9d26b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:34:53.624947 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-6e13e03c-0744-45ed-bfd0-fe672882d7e7 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] 10.222.0.66 "GET /compute/v2.1/servers/b324d2b4-4aa5-49a6-b530-35d9f3bc1a53" status: 200 len: 1319 microversion: 2.1 time: 0.275707 Jun 22 10:34:53.625991 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 500/1021] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:34:53 2022] GET /compute/v2.1/servers/b324d2b4-4aa5-49a6-b530-35d9f3bc1a53 => generated 1319 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:34:54.648666 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-35fe23a8-7ad6-4e99-a4c6-79f7d03c4531 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:34:54.649626 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-35fe23a8-7ad6-4e99-a4c6-79f7d03c4531 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] [instance: b324d2b4-4aa5-49a6-b530-35d9f3bc1a53] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:34:54.658541 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-35fe23a8-7ad6-4e99-a4c6-79f7d03c4531 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:54.658993 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-35fe23a8-7ad6-4e99-a4c6-79f7d03c4531 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:54.659791 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-35fe23a8-7ad6-4e99-a4c6-79f7d03c4531 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:54.660231 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-35fe23a8-7ad6-4e99-a4c6-79f7d03c4531 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:54.818190 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-35fe23a8-7ad6-4e99-a4c6-79f7d03c4531 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ddfdfeb7f4151bc84f166638123e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc445d96f85d4cf49747bf592ad9d26b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:34:54.827550 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-35fe23a8-7ad6-4e99-a4c6-79f7d03c4531 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] 10.222.0.66 "GET /compute/v2.1/servers/b324d2b4-4aa5-49a6-b530-35d9f3bc1a53" status: 200 len: 1319 microversion: 2.1 time: 0.183598 Jun 22 10:34:54.828158 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 522/1022] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:34:54 2022] GET /compute/v2.1/servers/b324d2b4-4aa5-49a6-b530-35d9f3bc1a53 => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:34:55.854249 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-62d117e2-0d87-4714-891a-c02774b71cd2 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:34:55.855355 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-62d117e2-0d87-4714-891a-c02774b71cd2 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] [instance: b324d2b4-4aa5-49a6-b530-35d9f3bc1a53] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:34:55.865563 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-62d117e2-0d87-4714-891a-c02774b71cd2 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:55.866348 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-62d117e2-0d87-4714-891a-c02774b71cd2 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:55.867731 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-62d117e2-0d87-4714-891a-c02774b71cd2 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:55.868417 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-62d117e2-0d87-4714-891a-c02774b71cd2 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:55.945588 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-27caed83-fae8-4831-962d-f80bfe2c7d6b req-48d5cfec-44c7-4464-bce9-12c8a438f15d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b324d2b4-4aa5-49a6-b530-35d9f3bc1a53", "name": "network-vif-plugged", "status": "completed", "tag": "a6e39273-efd0-4b88-85de-21b8091fe0ce"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:34:55.971707 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-27caed83-fae8-4831-962d-f80bfe2c7d6b req-48d5cfec-44c7-4464-bce9-12c8a438f15d service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:55.972932 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-27caed83-fae8-4831-962d-f80bfe2c7d6b req-48d5cfec-44c7-4464-bce9-12c8a438f15d service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:56.001193 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-27caed83-fae8-4831-962d-f80bfe2c7d6b req-48d5cfec-44c7-4464-bce9-12c8a438f15d service nova] Creating event network-vif-plugged:a6e39273-efd0-4b88-85de-21b8091fe0ce for instance b324d2b4-4aa5-49a6-b530-35d9f3bc1a53 on hv-cinder-84713 Jun 22 10:34:56.012684 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-27caed83-fae8-4831-962d-f80bfe2c7d6b req-48d5cfec-44c7-4464-bce9-12c8a438f15d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074803 Jun 22 10:34:56.013776 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 523/1023] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:34:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:34:56.058489 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-62d117e2-0d87-4714-891a-c02774b71cd2 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ddfdfeb7f4151bc84f166638123e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc445d96f85d4cf49747bf592ad9d26b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:34:56.068921 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-62d117e2-0d87-4714-891a-c02774b71cd2 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] 10.222.0.66 "GET /compute/v2.1/servers/b324d2b4-4aa5-49a6-b530-35d9f3bc1a53" status: 200 len: 1319 microversion: 2.1 time: 0.219141 Jun 22 10:34:56.069845 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 501/1024] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:34:55 2022] GET /compute/v2.1/servers/b324d2b4-4aa5-49a6-b530-35d9f3bc1a53 => generated 1319 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:34:57.089722 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-ee801b66-74f9-4157-b1e5-0c4deedd2dd1 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:34:57.090599 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-ee801b66-74f9-4157-b1e5-0c4deedd2dd1 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] [instance: b324d2b4-4aa5-49a6-b530-35d9f3bc1a53] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:34:57.099214 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ee801b66-74f9-4157-b1e5-0c4deedd2dd1 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:57.099664 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ee801b66-74f9-4157-b1e5-0c4deedd2dd1 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:57.100487 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ee801b66-74f9-4157-b1e5-0c4deedd2dd1 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:57.100929 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ee801b66-74f9-4157-b1e5-0c4deedd2dd1 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:57.252304 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-ee801b66-74f9-4157-b1e5-0c4deedd2dd1 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ddfdfeb7f4151bc84f166638123e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc445d96f85d4cf49747bf592ad9d26b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:34:57.260958 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-ee801b66-74f9-4157-b1e5-0c4deedd2dd1 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] 10.222.0.66 "GET /compute/v2.1/servers/b324d2b4-4aa5-49a6-b530-35d9f3bc1a53" status: 200 len: 1319 microversion: 2.1 time: 0.177142 Jun 22 10:34:57.261570 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 524/1025] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:34:57 2022] GET /compute/v2.1/servers/b324d2b4-4aa5-49a6-b530-35d9f3bc1a53 => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:34:58.280375 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-0cf36e87-ce26-420a-96e8-028028a1db45 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:34:58.281030 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-0cf36e87-ce26-420a-96e8-028028a1db45 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] [instance: b324d2b4-4aa5-49a6-b530-35d9f3bc1a53] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:34:58.283520 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_cell0:SELECT=2 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:34:58.289870 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0cf36e87-ce26-420a-96e8-028028a1db45 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:58.290371 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0cf36e87-ce26-420a-96e8-028028a1db45 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:58.291180 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0cf36e87-ce26-420a-96e8-028028a1db45 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:34:58.291618 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0cf36e87-ce26-420a-96e8-028028a1db45 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:34:58.445710 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-0cf36e87-ce26-420a-96e8-028028a1db45 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ddfdfeb7f4151bc84f166638123e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc445d96f85d4cf49747bf592ad9d26b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:34:58.459881 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-0cf36e87-ce26-420a-96e8-028028a1db45 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] 10.222.0.66 "GET /compute/v2.1/servers/b324d2b4-4aa5-49a6-b530-35d9f3bc1a53" status: 200 len: 1508 microversion: 2.1 time: 0.183633 Jun 22 10:34:58.460912 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 502/1026] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:34:58 2022] GET /compute/v2.1/servers/b324d2b4-4aa5-49a6-b530-35d9f3bc1a53 => generated 1508 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:35:20.260863 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-dd07f09e-9377-4902-8b72-19d3318e1b94 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cb222af0-e676-4beb-a4e3-9b60035be512", "device": "/dev/sdb"}} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:35:20.262711 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-dd07f09e-9377-4902-8b72-19d3318e1b94 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] [instance: b324d2b4-4aa5-49a6-b530-35d9f3bc1a53] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:35:20.265098 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell0:SELECT=2 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:35:20.265883 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell0:SELECT=6 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:35:20.266751 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:35:20.267539 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:SELECT=30 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:35:20.275844 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-dd07f09e-9377-4902-8b72-19d3318e1b94 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:35:20.276324 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-dd07f09e-9377-4902-8b72-19d3318e1b94 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:35:20.277159 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-dd07f09e-9377-4902-8b72-19d3318e1b94 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:35:20.277627 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-dd07f09e-9377-4902-8b72-19d3318e1b94 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:35:20.572663 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-dd07f09e-9377-4902-8b72-19d3318e1b94 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] 10.222.0.66 "POST /compute/v2.1/servers/b324d2b4-4aa5-49a6-b530-35d9f3bc1a53/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.315791 Jun 22 10:35:20.573785 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 525/1027] 10.222.0.66 () {60 vars in 1322 bytes} [Wed Jun 22 10:35:20 2022] POST /compute/v2.1/servers/b324d2b4-4aa5-49a6-b530-35d9f3bc1a53/os-volume_attachments => generated 194 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:35:23.344854 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-2fc0c7b0-caf9-4435-87f1-e378264cfb00 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:35:23.345892 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-2fc0c7b0-caf9-4435-87f1-e378264cfb00 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] [instance: d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:35:23.348627 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_api:SELECT=14 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:35:23.349490 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_cell1:SELECT=30 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:35:23.358863 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2fc0c7b0-caf9-4435-87f1-e378264cfb00 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:35:23.359315 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2fc0c7b0-caf9-4435-87f1-e378264cfb00 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:35:23.360107 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2fc0c7b0-caf9-4435-87f1-e378264cfb00 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:35:23.360543 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2fc0c7b0-caf9-4435-87f1-e378264cfb00 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:35:23.459382 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-2fc0c7b0-caf9-4435-87f1-e378264cfb00 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] 10.222.0.66 "POST /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f/action" status: 202 len: 0 microversion: 2.1 time: 0.119655 Jun 22 10:35:23.460052 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 503/1028] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Jun 22 10:35:23 2022] POST /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:35:23.474244 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-97284607-fd90-437b-9e72-baec704118bd tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:35:23.475714 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-97284607-fd90-437b-9e72-baec704118bd tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] [instance: d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:35:23.487192 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-97284607-fd90-437b-9e72-baec704118bd tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:35:23.487871 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-97284607-fd90-437b-9e72-baec704118bd tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:35:23.489109 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-97284607-fd90-437b-9e72-baec704118bd tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:35:23.489770 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-97284607-fd90-437b-9e72-baec704118bd tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:35:23.698529 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-97284607-fd90-437b-9e72-baec704118bd tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172df9a596fd4729967f3787533ea57d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ead3712348245f8862718ef0e30b3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:35:23.708512 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-97284607-fd90-437b-9e72-baec704118bd tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] 10.222.0.66 "GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f" status: 200 len: 1749 microversion: 2.1 time: 0.242524 Jun 22 10:35:23.709347 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 526/1029] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:35:23 2022] GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f => generated 1749 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:35:24.729208 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-2fea5276-e97e-4181-83df-fe21a0cc02e0 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:35:24.729998 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-2fea5276-e97e-4181-83df-fe21a0cc02e0 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] [instance: d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:35:24.737620 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2fea5276-e97e-4181-83df-fe21a0cc02e0 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:35:24.738030 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2fea5276-e97e-4181-83df-fe21a0cc02e0 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:35:24.738917 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2fea5276-e97e-4181-83df-fe21a0cc02e0 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:35:24.739385 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2fea5276-e97e-4181-83df-fe21a0cc02e0 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:35:24.921837 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-2fea5276-e97e-4181-83df-fe21a0cc02e0 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172df9a596fd4729967f3787533ea57d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ead3712348245f8862718ef0e30b3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:35:24.931522 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-2fea5276-e97e-4181-83df-fe21a0cc02e0 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] 10.222.0.66 "GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f" status: 200 len: 1754 microversion: 2.1 time: 0.207368 Jun 22 10:35:24.932136 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 504/1030] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:35:24 2022] GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f => generated 1754 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:35:25.965058 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-11060b15-6de6-48db-a6c3-9c7222c07e4c tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:35:25.965815 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-11060b15-6de6-48db-a6c3-9c7222c07e4c tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] [instance: d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:35:25.973302 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-11060b15-6de6-48db-a6c3-9c7222c07e4c tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:35:25.973730 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-11060b15-6de6-48db-a6c3-9c7222c07e4c tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:35:25.974619 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-11060b15-6de6-48db-a6c3-9c7222c07e4c tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:35:25.975160 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-11060b15-6de6-48db-a6c3-9c7222c07e4c tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:35:26.145473 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-11060b15-6de6-48db-a6c3-9c7222c07e4c tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172df9a596fd4729967f3787533ea57d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ead3712348245f8862718ef0e30b3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:35:26.155725 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-11060b15-6de6-48db-a6c3-9c7222c07e4c tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] 10.222.0.66 "GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f" status: 200 len: 1754 microversion: 2.1 time: 0.195554 Jun 22 10:35:26.156358 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 527/1031] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:35:25 2022] GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f => generated 1754 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:35:27.181030 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-3ebd3d31-630c-4660-a0ae-4333001b86de tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:35:27.181740 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-3ebd3d31-630c-4660-a0ae-4333001b86de tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] [instance: d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:35:27.190302 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3ebd3d31-630c-4660-a0ae-4333001b86de tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:35:27.190917 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3ebd3d31-630c-4660-a0ae-4333001b86de tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:35:27.191814 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3ebd3d31-630c-4660-a0ae-4333001b86de tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:35:27.192259 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3ebd3d31-630c-4660-a0ae-4333001b86de tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:35:27.360493 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-3ebd3d31-630c-4660-a0ae-4333001b86de tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172df9a596fd4729967f3787533ea57d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ead3712348245f8862718ef0e30b3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:35:27.369524 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-3ebd3d31-630c-4660-a0ae-4333001b86de tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] 10.222.0.66 "GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f" status: 200 len: 1754 microversion: 2.1 time: 0.192503 Jun 22 10:35:27.370103 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 505/1032] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:35:27 2022] GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f => generated 1754 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:35:28.398235 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-14010018-3408-45e9-9cff-246d25beae1c tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:35:28.399513 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-14010018-3408-45e9-9cff-246d25beae1c tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] [instance: d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:35:28.412179 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-14010018-3408-45e9-9cff-246d25beae1c tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:35:28.413193 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-14010018-3408-45e9-9cff-246d25beae1c tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:35:28.414826 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-14010018-3408-45e9-9cff-246d25beae1c tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:35:28.415626 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-14010018-3408-45e9-9cff-246d25beae1c tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:35:28.612555 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-14010018-3408-45e9-9cff-246d25beae1c tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172df9a596fd4729967f3787533ea57d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ead3712348245f8862718ef0e30b3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:35:28.621793 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-14010018-3408-45e9-9cff-246d25beae1c tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] 10.222.0.66 "GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f" status: 200 len: 1754 microversion: 2.1 time: 0.236298 Jun 22 10:35:28.622438 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 528/1033] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:35:28 2022] GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f => generated 1754 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:35:29.645272 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-950cfde6-983f-416d-9e19-917ce4716fad tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:35:29.645705 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-950cfde6-983f-416d-9e19-917ce4716fad tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] [instance: d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:35:29.659129 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-950cfde6-983f-416d-9e19-917ce4716fad tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:35:29.659949 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-950cfde6-983f-416d-9e19-917ce4716fad tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:35:29.661448 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-950cfde6-983f-416d-9e19-917ce4716fad tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:35:29.662351 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-950cfde6-983f-416d-9e19-917ce4716fad tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:35:29.849369 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-950cfde6-983f-416d-9e19-917ce4716fad tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172df9a596fd4729967f3787533ea57d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ead3712348245f8862718ef0e30b3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:35:29.862876 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-950cfde6-983f-416d-9e19-917ce4716fad tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] 10.222.0.66 "GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f" status: 200 len: 1754 microversion: 2.1 time: 0.225800 Jun 22 10:35:29.864008 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 506/1034] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:35:29 2022] GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f => generated 1754 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:35:30.888993 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-0f2752a7-6962-4156-b13f-335cb87a45cf tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:35:30.889654 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-0f2752a7-6962-4156-b13f-335cb87a45cf tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] [instance: d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:35:30.897534 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0f2752a7-6962-4156-b13f-335cb87a45cf tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:35:30.897980 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0f2752a7-6962-4156-b13f-335cb87a45cf tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:35:30.898813 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0f2752a7-6962-4156-b13f-335cb87a45cf tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:35:30.899252 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0f2752a7-6962-4156-b13f-335cb87a45cf tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:35:31.075179 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-0f2752a7-6962-4156-b13f-335cb87a45cf tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172df9a596fd4729967f3787533ea57d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ead3712348245f8862718ef0e30b3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:35:31.084645 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-0f2752a7-6962-4156-b13f-335cb87a45cf tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] 10.222.0.66 "GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f" status: 200 len: 1754 microversion: 2.1 time: 0.199716 Jun 22 10:35:31.085311 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 529/1035] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:35:30 2022] GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f => generated 1754 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:35:32.103925 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-34459e2b-27d8-4e4b-acad-309160679ac2 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:35:32.104648 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-34459e2b-27d8-4e4b-acad-309160679ac2 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] [instance: d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:35:32.112587 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-34459e2b-27d8-4e4b-acad-309160679ac2 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:35:32.113033 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-34459e2b-27d8-4e4b-acad-309160679ac2 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:35:32.113832 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-34459e2b-27d8-4e4b-acad-309160679ac2 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:35:32.114260 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-34459e2b-27d8-4e4b-acad-309160679ac2 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:35:32.318769 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-34459e2b-27d8-4e4b-acad-309160679ac2 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172df9a596fd4729967f3787533ea57d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ead3712348245f8862718ef0e30b3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:35:32.329085 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-34459e2b-27d8-4e4b-acad-309160679ac2 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] 10.222.0.66 "GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f" status: 200 len: 1754 microversion: 2.1 time: 0.229988 Jun 22 10:35:32.329715 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 507/1036] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:35:32 2022] GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f => generated 1754 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:35:33.355616 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-0af20e72-5145-4154-a988-f562aa50a68c tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:35:33.356612 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-0af20e72-5145-4154-a988-f562aa50a68c tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] [instance: d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:35:33.365077 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0af20e72-5145-4154-a988-f562aa50a68c tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:35:33.365657 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0af20e72-5145-4154-a988-f562aa50a68c tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:35:33.366697 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0af20e72-5145-4154-a988-f562aa50a68c tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:35:33.367386 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0af20e72-5145-4154-a988-f562aa50a68c tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:35:33.857730 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-0af20e72-5145-4154-a988-f562aa50a68c tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172df9a596fd4729967f3787533ea57d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ead3712348245f8862718ef0e30b3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:35:33.873864 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-0af20e72-5145-4154-a988-f562aa50a68c tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] 10.222.0.66 "GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f" status: 200 len: 1754 microversion: 2.1 time: 0.522330 Jun 22 10:35:33.874877 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 530/1037] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:35:33 2022] GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f => generated 1754 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:35:34.895399 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-7ec1f22d-9e51-4167-acd4-89f757f7cfbf tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:35:34.896038 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-7ec1f22d-9e51-4167-acd4-89f757f7cfbf tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] [instance: d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:35:34.904207 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7ec1f22d-9e51-4167-acd4-89f757f7cfbf tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:35:34.904660 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7ec1f22d-9e51-4167-acd4-89f757f7cfbf tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:35:34.905458 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7ec1f22d-9e51-4167-acd4-89f757f7cfbf tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:35:34.905900 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7ec1f22d-9e51-4167-acd4-89f757f7cfbf tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:35:35.137744 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-7ec1f22d-9e51-4167-acd4-89f757f7cfbf tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172df9a596fd4729967f3787533ea57d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ead3712348245f8862718ef0e30b3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:35:35.148329 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-7ec1f22d-9e51-4167-acd4-89f757f7cfbf tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] 10.222.0.66 "GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f" status: 200 len: 1754 microversion: 2.1 time: 0.256892 Jun 22 10:35:35.148978 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 508/1038] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:35:34 2022] GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f => generated 1754 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:35:36.167530 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-8d6010ec-e3f7-436d-97e6-cb048a73dada tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:35:36.168227 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-8d6010ec-e3f7-436d-97e6-cb048a73dada tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] [instance: d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:35:36.175882 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8d6010ec-e3f7-436d-97e6-cb048a73dada tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:35:36.176340 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8d6010ec-e3f7-436d-97e6-cb048a73dada tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:35:36.177156 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8d6010ec-e3f7-436d-97e6-cb048a73dada tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:35:36.177571 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8d6010ec-e3f7-436d-97e6-cb048a73dada tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:35:36.341210 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-8d6010ec-e3f7-436d-97e6-cb048a73dada tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172df9a596fd4729967f3787533ea57d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ead3712348245f8862718ef0e30b3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:35:36.350737 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-8d6010ec-e3f7-436d-97e6-cb048a73dada tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] 10.222.0.66 "GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f" status: 200 len: 1754 microversion: 2.1 time: 0.187112 Jun 22 10:35:36.351349 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 531/1039] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:35:36 2022] GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f => generated 1754 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:35:37.370126 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-6ea93494-98d6-4276-bd79-a99e4b3640e2 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:35:37.370875 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-6ea93494-98d6-4276-bd79-a99e4b3640e2 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] [instance: d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:35:37.379095 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6ea93494-98d6-4276-bd79-a99e4b3640e2 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:35:37.379563 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6ea93494-98d6-4276-bd79-a99e4b3640e2 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:35:37.380383 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6ea93494-98d6-4276-bd79-a99e4b3640e2 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:35:37.380826 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6ea93494-98d6-4276-bd79-a99e4b3640e2 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:35:37.547773 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-6ea93494-98d6-4276-bd79-a99e4b3640e2 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172df9a596fd4729967f3787533ea57d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ead3712348245f8862718ef0e30b3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:35:37.556663 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-6ea93494-98d6-4276-bd79-a99e4b3640e2 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] 10.222.0.66 "GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f" status: 200 len: 1754 microversion: 2.1 time: 0.191285 Jun 22 10:35:37.557261 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 509/1040] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:35:37 2022] GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f => generated 1754 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:35:38.574388 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-20f14863-cd33-485d-a390-0079462b7d40 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:35:38.575052 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-20f14863-cd33-485d-a390-0079462b7d40 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] [instance: d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:35:38.583083 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-20f14863-cd33-485d-a390-0079462b7d40 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:35:38.583591 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-20f14863-cd33-485d-a390-0079462b7d40 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:35:38.584509 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-20f14863-cd33-485d-a390-0079462b7d40 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:35:38.584988 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-20f14863-cd33-485d-a390-0079462b7d40 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:35:38.762870 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-20f14863-cd33-485d-a390-0079462b7d40 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172df9a596fd4729967f3787533ea57d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ead3712348245f8862718ef0e30b3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:35:38.777934 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-20f14863-cd33-485d-a390-0079462b7d40 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] 10.222.0.66 "GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f" status: 200 len: 1754 microversion: 2.1 time: 0.207175 Jun 22 10:35:38.779337 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 532/1041] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:35:38 2022] GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f => generated 1754 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:35:39.797746 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-47e69fb2-c619-4bc8-8742-bc8ef565c5c9 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:35:39.798480 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-47e69fb2-c619-4bc8-8742-bc8ef565c5c9 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] [instance: d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:35:39.807556 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-47e69fb2-c619-4bc8-8742-bc8ef565c5c9 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:35:39.808331 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-47e69fb2-c619-4bc8-8742-bc8ef565c5c9 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:35:39.809690 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-47e69fb2-c619-4bc8-8742-bc8ef565c5c9 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:35:39.810385 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-47e69fb2-c619-4bc8-8742-bc8ef565c5c9 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:35:39.977423 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-47e69fb2-c619-4bc8-8742-bc8ef565c5c9 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172df9a596fd4729967f3787533ea57d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ead3712348245f8862718ef0e30b3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:35:39.987436 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-47e69fb2-c619-4bc8-8742-bc8ef565c5c9 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] 10.222.0.66 "GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f" status: 200 len: 1754 microversion: 2.1 time: 0.194050 Jun 22 10:35:39.988220 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 510/1042] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:35:39 2022] GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f => generated 1754 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:35:41.005953 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-0db37b5a-020b-4f04-8665-22f594fadfa0 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:35:41.006596 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-0db37b5a-020b-4f04-8665-22f594fadfa0 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] [instance: d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:35:41.013982 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0db37b5a-020b-4f04-8665-22f594fadfa0 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:35:41.014438 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0db37b5a-020b-4f04-8665-22f594fadfa0 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:35:41.015381 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0db37b5a-020b-4f04-8665-22f594fadfa0 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:35:41.015692 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0db37b5a-020b-4f04-8665-22f594fadfa0 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:35:41.213153 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-0db37b5a-020b-4f04-8665-22f594fadfa0 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172df9a596fd4729967f3787533ea57d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ead3712348245f8862718ef0e30b3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:35:41.222393 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-0db37b5a-020b-4f04-8665-22f594fadfa0 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] 10.222.0.66 "GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f" status: 200 len: 1754 microversion: 2.1 time: 0.220436 Jun 22 10:35:41.223040 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 533/1043] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:35:41 2022] GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f => generated 1754 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:35:42.240884 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-f8c27413-0d25-417b-aaaf-79973809a6bc tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:35:42.241539 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-f8c27413-0d25-417b-aaaf-79973809a6bc tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] [instance: d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:35:42.249588 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f8c27413-0d25-417b-aaaf-79973809a6bc tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:35:42.250135 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f8c27413-0d25-417b-aaaf-79973809a6bc tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:35:42.251555 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f8c27413-0d25-417b-aaaf-79973809a6bc tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:35:42.252094 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f8c27413-0d25-417b-aaaf-79973809a6bc tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:35:42.462853 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-f8c27413-0d25-417b-aaaf-79973809a6bc tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172df9a596fd4729967f3787533ea57d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ead3712348245f8862718ef0e30b3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:35:42.473023 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-f8c27413-0d25-417b-aaaf-79973809a6bc tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] 10.222.0.66 "GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f" status: 200 len: 1754 microversion: 2.1 time: 0.236243 Jun 22 10:35:42.473695 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 511/1044] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:35:42 2022] GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f => generated 1754 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:35:43.492077 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-1a5168f2-f6d7-46f4-b3e4-655a7dde81da tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:35:43.492895 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-1a5168f2-f6d7-46f4-b3e4-655a7dde81da tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] [instance: d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:35:43.501629 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1a5168f2-f6d7-46f4-b3e4-655a7dde81da tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:35:43.501918 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1a5168f2-f6d7-46f4-b3e4-655a7dde81da tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:35:43.502838 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1a5168f2-f6d7-46f4-b3e4-655a7dde81da tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:35:43.503407 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1a5168f2-f6d7-46f4-b3e4-655a7dde81da tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:35:43.705596 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-1a5168f2-f6d7-46f4-b3e4-655a7dde81da tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172df9a596fd4729967f3787533ea57d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ead3712348245f8862718ef0e30b3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:35:43.715113 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-1a5168f2-f6d7-46f4-b3e4-655a7dde81da tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] 10.222.0.66 "GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f" status: 200 len: 1754 microversion: 2.1 time: 0.227368 Jun 22 10:35:43.715794 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 534/1045] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:35:43 2022] GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f => generated 1754 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:35:44.738283 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-82edd0fa-9a10-4606-843f-e33f1fb560d2 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:35:44.739695 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-82edd0fa-9a10-4606-843f-e33f1fb560d2 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] [instance: d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:35:44.750632 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-82edd0fa-9a10-4606-843f-e33f1fb560d2 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:35:44.751237 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-82edd0fa-9a10-4606-843f-e33f1fb560d2 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:35:44.752219 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-82edd0fa-9a10-4606-843f-e33f1fb560d2 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:35:44.752798 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-82edd0fa-9a10-4606-843f-e33f1fb560d2 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:35:44.963413 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-82edd0fa-9a10-4606-843f-e33f1fb560d2 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172df9a596fd4729967f3787533ea57d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ead3712348245f8862718ef0e30b3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:35:44.973932 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-82edd0fa-9a10-4606-843f-e33f1fb560d2 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] 10.222.0.66 "GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f" status: 200 len: 1757 microversion: 2.1 time: 0.243118 Jun 22 10:35:44.974664 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 512/1046] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:35:44 2022] GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f => generated 1757 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:35:45.840375 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 10:35:45.841088 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Wed Jun 22 10:35:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 10:35:46.726558 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 10:35:46.726831 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Wed Jun 22 10:35:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 10:35:47.989616 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-999a5843-b8c7-462b-a08f-4f21ecd98c84 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:35:47.990329 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-999a5843-b8c7-462b-a08f-4f21ecd98c84 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] [instance: b324d2b4-4aa5-49a6-b530-35d9f3bc1a53] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:35:47.997984 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-999a5843-b8c7-462b-a08f-4f21ecd98c84 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:35:47.998591 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-999a5843-b8c7-462b-a08f-4f21ecd98c84 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:35:47.999575 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-999a5843-b8c7-462b-a08f-4f21ecd98c84 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:35:48.000086 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-999a5843-b8c7-462b-a08f-4f21ecd98c84 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:35:48.096138 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.objects.instance [None req-999a5843-b8c7-462b-a08f-4f21ecd98c84 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lazy-loading 'services' on Instance uuid b324d2b4-4aa5-49a6-b530-35d9f3bc1a53 {{(pid=117680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:35:48.184534 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-999a5843-b8c7-462b-a08f-4f21ecd98c84 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] 10.222.0.66 "DELETE /compute/v2.1/servers/b324d2b4-4aa5-49a6-b530-35d9f3bc1a53/os-volume_attachments/cb222af0-e676-4beb-a4e3-9b60035be512" status: 202 len: 0 microversion: 2.1 time: 0.199010 Jun 22 10:35:48.185125 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 535/1047] 10.222.0.66 () {58 vars in 1415 bytes} [Wed Jun 22 10:35:47 2022] DELETE /compute/v2.1/servers/b324d2b4-4aa5-49a6-b530-35d9f3bc1a53/os-volume_attachments/cb222af0-e676-4beb-a4e3-9b60035be512 => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:35:49.341227 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-6ecd3dc9-3d80-40ee-9631-6991ec199315 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:35:49.341979 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-6ecd3dc9-3d80-40ee-9631-6991ec199315 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] [instance: b324d2b4-4aa5-49a6-b530-35d9f3bc1a53] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:35:49.349243 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6ecd3dc9-3d80-40ee-9631-6991ec199315 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:35:49.349692 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6ecd3dc9-3d80-40ee-9631-6991ec199315 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:35:49.350466 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6ecd3dc9-3d80-40ee-9631-6991ec199315 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:35:49.350976 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6ecd3dc9-3d80-40ee-9631-6991ec199315 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:35:49.382299 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-6ecd3dc9-3d80-40ee-9631-6991ec199315 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] [instance: b324d2b4-4aa5-49a6-b530-35d9f3bc1a53] Going to try to terminate instance {{(pid=117679) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 10:35:49.481106 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-6ecd3dc9-3d80-40ee-9631-6991ec199315 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] 10.222.0.66 "DELETE /compute/v2.1/servers/b324d2b4-4aa5-49a6-b530-35d9f3bc1a53" status: 204 len: 0 microversion: 2.1 time: 0.143209 Jun 22 10:35:49.482345 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 513/1048] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Jun 22 10:35:49 2022] DELETE /compute/v2.1/servers/b324d2b4-4aa5-49a6-b530-35d9f3bc1a53 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 10:35:49.496119 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-c2bb596f-1640-4c05-9ac6-7ed66f11f395 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:35:49.497084 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-c2bb596f-1640-4c05-9ac6-7ed66f11f395 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] [instance: b324d2b4-4aa5-49a6-b530-35d9f3bc1a53] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:35:49.504199 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-c2bb596f-1640-4c05-9ac6-7ed66f11f395 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:35:49.504644 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-c2bb596f-1640-4c05-9ac6-7ed66f11f395 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:35:49.505449 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-c2bb596f-1640-4c05-9ac6-7ed66f11f395 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:35:49.505959 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-c2bb596f-1640-4c05-9ac6-7ed66f11f395 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:35:49.683362 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-c2bb596f-1640-4c05-9ac6-7ed66f11f395 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ddfdfeb7f4151bc84f166638123e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc445d96f85d4cf49747bf592ad9d26b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:35:49.692094 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-c2bb596f-1640-4c05-9ac6-7ed66f11f395 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] 10.222.0.66 "GET /compute/v2.1/servers/b324d2b4-4aa5-49a6-b530-35d9f3bc1a53" status: 200 len: 1514 microversion: 2.1 time: 0.202891 Jun 22 10:35:49.692687 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 536/1049] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:35:49 2022] GET /compute/v2.1/servers/b324d2b4-4aa5-49a6-b530-35d9f3bc1a53 => generated 1514 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:35:50.711932 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-237c67df-7334-4203-ba8f-bb3e60b3a090 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:35:50.712615 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-237c67df-7334-4203-ba8f-bb3e60b3a090 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] [instance: b324d2b4-4aa5-49a6-b530-35d9f3bc1a53] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:35:50.720391 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-237c67df-7334-4203-ba8f-bb3e60b3a090 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:35:50.720841 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-237c67df-7334-4203-ba8f-bb3e60b3a090 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:35:50.721609 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-237c67df-7334-4203-ba8f-bb3e60b3a090 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:35:50.722044 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-237c67df-7334-4203-ba8f-bb3e60b3a090 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:35:50.876983 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-237c67df-7334-4203-ba8f-bb3e60b3a090 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ddfdfeb7f4151bc84f166638123e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc445d96f85d4cf49747bf592ad9d26b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:35:50.886194 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-237c67df-7334-4203-ba8f-bb3e60b3a090 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] 10.222.0.66 "GET /compute/v2.1/servers/b324d2b4-4aa5-49a6-b530-35d9f3bc1a53" status: 200 len: 1514 microversion: 2.1 time: 0.179646 Jun 22 10:35:50.886863 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 514/1050] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:35:50 2022] GET /compute/v2.1/servers/b324d2b4-4aa5-49a6-b530-35d9f3bc1a53 => generated 1514 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:35:51.905176 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-0f807bb2-1519-4c12-a862-744d14078971 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:35:51.906111 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-0f807bb2-1519-4c12-a862-744d14078971 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] [instance: b324d2b4-4aa5-49a6-b530-35d9f3bc1a53] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:35:51.908768 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_api:SELECT=25 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:35:51.918191 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0f807bb2-1519-4c12-a862-744d14078971 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:35:51.918850 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0f807bb2-1519-4c12-a862-744d14078971 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:35:51.919931 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0f807bb2-1519-4c12-a862-744d14078971 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:35:51.920517 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-0f807bb2-1519-4c12-a862-744d14078971 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:35:51.927389 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:35:52.064183 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-0f807bb2-1519-4c12-a862-744d14078971 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ddfdfeb7f4151bc84f166638123e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc445d96f85d4cf49747bf592ad9d26b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:35:52.082298 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-0f807bb2-1519-4c12-a862-744d14078971 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] 10.222.0.66 "GET /compute/v2.1/servers/b324d2b4-4aa5-49a6-b530-35d9f3bc1a53" status: 200 len: 1472 microversion: 2.1 time: 0.181346 Jun 22 10:35:52.083282 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 537/1051] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:35:51 2022] GET /compute/v2.1/servers/b324d2b4-4aa5-49a6-b530-35d9f3bc1a53 => generated 1472 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:35:52.459157 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-72830dfb-8f7a-490d-8ffd-b76eb590cf59 req-0e402b93-c289-4d23-add1-e21ee344b9f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b324d2b4-4aa5-49a6-b530-35d9f3bc1a53", "name": "network-vif-deleted", "tag": "a6e39273-efd0-4b88-85de-21b8091fe0ce"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:35:52.471819 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-72830dfb-8f7a-490d-8ffd-b76eb590cf59 req-0e402b93-c289-4d23-add1-e21ee344b9f6 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:35:52.472530 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-72830dfb-8f7a-490d-8ffd-b76eb590cf59 req-0e402b93-c289-4d23-add1-e21ee344b9f6 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:35:52.493973 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-72830dfb-8f7a-490d-8ffd-b76eb590cf59 req-0e402b93-c289-4d23-add1-e21ee344b9f6 service nova] Creating event network-vif-deleted:a6e39273-efd0-4b88-85de-21b8091fe0ce for instance b324d2b4-4aa5-49a6-b530-35d9f3bc1a53 on hv-cinder-84713 Jun 22 10:35:52.502362 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-72830dfb-8f7a-490d-8ffd-b76eb590cf59 req-0e402b93-c289-4d23-add1-e21ee344b9f6 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051854 Jun 22 10:35:52.503156 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 515/1052] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:35:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:35:53.108215 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-3bf4945d-33a4-49cb-96d7-8c0778b3e47b tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:35:53.108905 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-3bf4945d-33a4-49cb-96d7-8c0778b3e47b tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] [instance: b324d2b4-4aa5-49a6-b530-35d9f3bc1a53] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:35:53.116558 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3bf4945d-33a4-49cb-96d7-8c0778b3e47b tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:35:53.117033 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3bf4945d-33a4-49cb-96d7-8c0778b3e47b tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:35:53.117830 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3bf4945d-33a4-49cb-96d7-8c0778b3e47b tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:35:53.118256 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3bf4945d-33a4-49cb-96d7-8c0778b3e47b tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:35:53.133413 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.wsgi [None req-3bf4945d-33a4-49cb-96d7-8c0778b3e47b tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] HTTP exception thrown: Instance b324d2b4-4aa5-49a6-b530-35d9f3bc1a53 could not be found. Jun 22 10:35:53.135165 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-3bf4945d-33a4-49cb-96d7-8c0778b3e47b tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Request method failure captured: Jun 22 10:35:53.135165 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: request: GET /compute/v2.1/servers/b324d2b4-4aa5-49a6-b530-35d9f3bc1a53 HTTP/1.1 Jun 22 10:35:53.135165 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Accept: application/json Jun 22 10:35:53.135165 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Accept-Encoding: identity Jun 22 10:35:53.135165 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Connection: close Jun 22 10:35:53.135165 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Content-Length: 0 Jun 22 10:35:53.135165 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Content-Type: application/json Jun 22 10:35:53.135165 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Host: 10.222.0.66 Jun 22 10:35:53.135165 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Openstack-System-Scope: None Jun 22 10:35:53.135165 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: User-Agent: python-urllib3/1.26.9 Jun 22 10:35:53.135165 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Auth-Token: gAAAAABisvBEuFpBV2cyu0b3SaBJMcR2hYwtQdUIPP5YPFcs_pZJNb9cqCsOBbTAhBmbZ2oCeCdPXlP2hUVE9R-p_2bAZzFvm8T1zCuvz_xaxrnrA5ZA4gonzWgOGv4o10nw-vOJCB62Dzgj0LE6MCgj4vdm3t0tjifAcfsLQthc6xdPUFmC4pg Jun 22 10:35:53.135165 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Domain-Id: None Jun 22 10:35:53.135165 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Domain-Name: None Jun 22 10:35:53.135165 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Identity-Status: Confirmed Jun 22 10:35:53.135165 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Is-Admin-Project: True Jun 22 10:35:53.135165 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Domain-Id: default Jun 22 10:35:53.135165 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Domain-Name: Default Jun 22 10:35:53.135165 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Id: cc445d96f85d4cf49747bf592ad9d26b Jun 22 10:35:53.135165 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Project-Name: tempest-VolumesSnapshotTestJSON-507012914 Jun 22 10:35:53.135165 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Role: member,reader Jun 22 10:35:53.135165 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Roles: member,reader Jun 22 10:35:53.138315 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_cc445d96f85d4cf49747bf592ad9d26b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/cc445d96f85d4cf49747bf592ad9d26b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/cc445d96f85d4cf49747bf592ad9d26b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/cc445d96f85d4cf49747bf592ad9d26b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}] Jun 22 10:35:53.138315 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant: tempest-VolumesSnapshotTestJSON-507012914 Jun 22 10:35:53.138315 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant-Id: cc445d96f85d4cf49747bf592ad9d26b Jun 22 10:35:53.138315 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-507012914 Jun 22 10:35:53.138315 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User: tempest-VolumesSnapshotTestJSON-507012914-project Jun 22 10:35:53.138315 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Domain-Id: default Jun 22 10:35:53.138315 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Domain-Name: Default Jun 22 10:35:53.138315 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Id: 004ddfdfeb7f4151bc84f166638123e4 Jun 22 10:35:53.138315 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: X-User-Name: tempest-VolumesSnapshotTestJSON-507012914-project Jun 22 10:35:53.138315 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: method: > Jun 22 10:35:53.138315 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: exception: Instance b324d2b4-4aa5-49a6-b530-35d9f3bc1a53 could not be found. Jun 22 10:35:53.138315 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: action_args: {'id': 'b324d2b4-4aa5-49a6-b530-35d9f3bc1a53'} Jun 22 10:35:53.140062 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:35:53.140062 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:35:53.140062 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:35:53.140062 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:35:53.140062 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:35:53.140062 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:35:53.140062 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:35:53.140062 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:35:53.140062 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:35:53.140062 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:35:53.140062 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b324d2b4-4aa5-49a6-b530-35d9f3bc1a53 could not be found. Jun 22 10:35:53.140062 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:35:53.140062 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:35:53.140062 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:35:53.140062 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:35:53.140062 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:35:53.140062 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:35:53.140062 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:35:53.140062 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:35:53.140062 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:35:53.142873 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:35:53.142873 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:35:53.142873 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:35:53.142873 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:35:53.142873 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:35:53.142873 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:35:53.142873 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:35:53.142873 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b324d2b4-4aa5-49a6-b530-35d9f3bc1a53 could not be found. Jun 22 10:35:53.142873 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:35:53.142873 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:35:53.142873 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:35:53.142873 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:35:53.142873 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:35:53.142873 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:35:53.142873 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:35:53.142873 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:35:53.142873 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b324d2b4-4aa5-49a6-b530-35d9f3bc1a53 could not be found. Jun 22 10:35:53.142873 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR nova.api.openstack.wsgi Jun 22 10:35:53.145308 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-3bf4945d-33a4-49cb-96d7-8c0778b3e47b tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Returning 404 to user: Instance b324d2b4-4aa5-49a6-b530-35d9f3bc1a53 could not be found. {{(pid=117680) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:35:53.145308 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-3bf4945d-33a4-49cb-96d7-8c0778b3e47b tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] 10.222.0.66 "GET /compute/v2.1/servers/b324d2b4-4aa5-49a6-b530-35d9f3bc1a53" status: 404 len: 111 microversion: 2.1 time: 0.032737 Jun 22 10:35:53.145308 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 538/1053] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:35:53 2022] GET /compute/v2.1/servers/b324d2b4-4aa5-49a6-b530-35d9f3bc1a53 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:36:04.205466 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:36:04.206695 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:36:04.214718 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-bb0d3c50-01fa-495e-9fe7-b68288ece683 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-952966110", "imageRef": "58addf50-5317-403a-beb0-4760bdbcaa13", "flavorRef": "452", "networks": [{"uuid": "00a21b97-a81a-4bf7-9dd7-0f9803d9bdb7"}]}} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:36:04.290923 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.network.neutron [None req-bb0d3c50-01fa-495e-9fe7-b68288ece683 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] validate_networks() for [('00a21b97-a81a-4bf7-9dd7-0f9803d9bdb7', None, None, None, None, None)] {{(pid=117679) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 10:36:04.684509 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-bb0d3c50-01fa-495e-9fe7-b68288ece683 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Flavor limits 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 10:36:04.684936 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-bb0d3c50-01fa-495e-9fe7-b68288ece683 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Image limits 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 10:36:04.685415 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-bb0d3c50-01fa-495e-9fe7-b68288ece683 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Flavor pref 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 10:36:04.685823 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-bb0d3c50-01fa-495e-9fe7-b68288ece683 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Image pref 0:0:0 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 10:36:04.686234 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.virt.hardware [None req-bb0d3c50-01fa-495e-9fe7-b68288ece683 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117679) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 10:36:04.696702 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-bb0d3c50-01fa-495e-9fe7-b68288ece683 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:04.697153 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-bb0d3c50-01fa-495e-9fe7-b68288ece683 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:04.698083 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-bb0d3c50-01fa-495e-9fe7-b68288ece683 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:04.698551 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-bb0d3c50-01fa-495e-9fe7-b68288ece683 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:04.718143 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.quota [None req-bb0d3c50-01fa-495e-9fe7-b68288ece683 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Getting quotas for project cc445d96f85d4cf49747bf592ad9d26b. Resources: {'instances', 'cores', 'ram'} {{(pid=117679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:36:04.723225 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.quota [None req-bb0d3c50-01fa-495e-9fe7-b68288ece683 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Getting quotas for user 004ddfdfeb7f4151bc84f166638123e4 and project cc445d96f85d4cf49747bf592ad9d26b. Resources: {'instances', 'cores', 'ram'} {{(pid=117679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:36:04.736802 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-bb0d3c50-01fa-495e-9fe7-b68288ece683 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Going to run 1 instances... {{(pid=117679) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 10:36:04.739290 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-bb0d3c50-01fa-495e-9fe7-b68288ece683 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] [instance: a96c633a-12f4-416c-a80c-7b3b615c0889] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='58addf50-5317-403a-beb0-4760bdbcaa13',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117679) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 10:36:04.791266 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-bb0d3c50-01fa-495e-9fe7-b68288ece683 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.588931 Jun 22 10:36:04.791942 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 516/1054] 10.222.0.66 () {60 vars in 1146 bytes} [Wed Jun 22 10:36:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 591 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 10:36:04.802569 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-934b0c6e-c023-4598-b74f-1242eb1b3f96 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:36:04.803333 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-934b0c6e-c023-4598-b74f-1242eb1b3f96 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] [instance: a96c633a-12f4-416c-a80c-7b3b615c0889] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:36:04.805909 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_api:SELECT=3 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:36:04.806699 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:SELECT=7 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:36:04.883939 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-934b0c6e-c023-4598-b74f-1242eb1b3f96 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ddfdfeb7f4151bc84f166638123e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc445d96f85d4cf49747bf592ad9d26b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:36:04.895498 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-934b0c6e-c023-4598-b74f-1242eb1b3f96 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] 10.222.0.66 "GET /compute/v2.1/servers/a96c633a-12f4-416c-a80c-7b3b615c0889" status: 200 len: 1218 microversion: 2.1 time: 0.096818 Jun 22 10:36:04.896386 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 539/1055] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:36:04 2022] GET /compute/v2.1/servers/a96c633a-12f4-416c-a80c-7b3b615c0889 => generated 1218 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:36:05.916403 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-216b2fa7-5b69-496d-ae15-834854cfc4f8 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:36:05.917791 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-216b2fa7-5b69-496d-ae15-834854cfc4f8 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] [instance: a96c633a-12f4-416c-a80c-7b3b615c0889] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:36:05.925772 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-216b2fa7-5b69-496d-ae15-834854cfc4f8 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:05.926241 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-216b2fa7-5b69-496d-ae15-834854cfc4f8 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:05.927228 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-216b2fa7-5b69-496d-ae15-834854cfc4f8 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:05.927815 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-216b2fa7-5b69-496d-ae15-834854cfc4f8 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:06.035559 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-216b2fa7-5b69-496d-ae15-834854cfc4f8 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ddfdfeb7f4151bc84f166638123e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc445d96f85d4cf49747bf592ad9d26b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:36:06.047053 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-216b2fa7-5b69-496d-ae15-834854cfc4f8 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] 10.222.0.66 "GET /compute/v2.1/servers/a96c633a-12f4-416c-a80c-7b3b615c0889" status: 200 len: 1278 microversion: 2.1 time: 0.134961 Jun 22 10:36:06.051085 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 517/1056] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:36:05 2022] GET /compute/v2.1/servers/a96c633a-12f4-416c-a80c-7b3b615c0889 => generated 1278 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:36:07.067897 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-9693d8f1-ca05-4694-9053-915b307b4f7b tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:36:07.068566 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-9693d8f1-ca05-4694-9053-915b307b4f7b tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] [instance: a96c633a-12f4-416c-a80c-7b3b615c0889] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:36:07.076997 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9693d8f1-ca05-4694-9053-915b307b4f7b tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:07.077438 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9693d8f1-ca05-4694-9053-915b307b4f7b tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:07.078233 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9693d8f1-ca05-4694-9053-915b307b4f7b tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:07.078703 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9693d8f1-ca05-4694-9053-915b307b4f7b tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:07.320450 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-9693d8f1-ca05-4694-9053-915b307b4f7b tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ddfdfeb7f4151bc84f166638123e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc445d96f85d4cf49747bf592ad9d26b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:36:07.330564 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-9693d8f1-ca05-4694-9053-915b307b4f7b tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] 10.222.0.66 "GET /compute/v2.1/servers/a96c633a-12f4-416c-a80c-7b3b615c0889" status: 200 len: 1318 microversion: 2.1 time: 0.266418 Jun 22 10:36:07.331455 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 540/1057] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:36:07 2022] GET /compute/v2.1/servers/a96c633a-12f4-416c-a80c-7b3b615c0889 => generated 1318 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:36:07.712463 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-235aed25-a57a-4c29-ac1f-b00db386e166 req-519629b5-3c57-4312-af40-a765754c5d21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a96c633a-12f4-416c-a80c-7b3b615c0889", "tag": "e5383603-5f8a-44a4-ac4d-f05f1f68349e"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:36:07.731162 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-235aed25-a57a-4c29-ac1f-b00db386e166 req-519629b5-3c57-4312-af40-a765754c5d21 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:07.731837 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-235aed25-a57a-4c29-ac1f-b00db386e166 req-519629b5-3c57-4312-af40-a765754c5d21 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:07.753656 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-235aed25-a57a-4c29-ac1f-b00db386e166 req-519629b5-3c57-4312-af40-a765754c5d21 service nova] Creating event network-changed:e5383603-5f8a-44a4-ac4d-f05f1f68349e for instance a96c633a-12f4-416c-a80c-7b3b615c0889 on hv-cinder-84713 Jun 22 10:36:07.764082 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-235aed25-a57a-4c29-ac1f-b00db386e166 req-519629b5-3c57-4312-af40-a765754c5d21 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055399 Jun 22 10:36:07.765018 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 518/1058] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:36:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:36:08.349885 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-8fdfacb7-1410-4188-8fd2-894a19805917 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:36:08.350770 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-8fdfacb7-1410-4188-8fd2-894a19805917 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] [instance: a96c633a-12f4-416c-a80c-7b3b615c0889] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:36:08.358375 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8fdfacb7-1410-4188-8fd2-894a19805917 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:08.358823 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8fdfacb7-1410-4188-8fd2-894a19805917 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:08.359630 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8fdfacb7-1410-4188-8fd2-894a19805917 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:08.360071 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8fdfacb7-1410-4188-8fd2-894a19805917 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:08.552074 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-8fdfacb7-1410-4188-8fd2-894a19805917 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ddfdfeb7f4151bc84f166638123e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc445d96f85d4cf49747bf592ad9d26b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:36:08.560991 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-8fdfacb7-1410-4188-8fd2-894a19805917 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] 10.222.0.66 "GET /compute/v2.1/servers/a96c633a-12f4-416c-a80c-7b3b615c0889" status: 200 len: 1318 microversion: 2.1 time: 0.215199 Jun 22 10:36:08.561583 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 541/1059] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:36:08 2022] GET /compute/v2.1/servers/a96c633a-12f4-416c-a80c-7b3b615c0889 => generated 1318 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:36:09.580036 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-bef6a137-73f7-4147-ace3-5fb0d124dbe0 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:36:09.580743 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-bef6a137-73f7-4147-ace3-5fb0d124dbe0 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] [instance: a96c633a-12f4-416c-a80c-7b3b615c0889] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:36:09.588330 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-bef6a137-73f7-4147-ace3-5fb0d124dbe0 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:09.588778 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-bef6a137-73f7-4147-ace3-5fb0d124dbe0 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:09.589570 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-bef6a137-73f7-4147-ace3-5fb0d124dbe0 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:09.589998 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-bef6a137-73f7-4147-ace3-5fb0d124dbe0 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:09.750555 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-bef6a137-73f7-4147-ace3-5fb0d124dbe0 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ddfdfeb7f4151bc84f166638123e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc445d96f85d4cf49747bf592ad9d26b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:36:09.759344 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-bef6a137-73f7-4147-ace3-5fb0d124dbe0 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] 10.222.0.66 "GET /compute/v2.1/servers/a96c633a-12f4-416c-a80c-7b3b615c0889" status: 200 len: 1318 microversion: 2.1 time: 0.184201 Jun 22 10:36:09.760083 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 519/1060] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:36:09 2022] GET /compute/v2.1/servers/a96c633a-12f4-416c-a80c-7b3b615c0889 => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:36:10.778123 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-57484943-615d-4367-b7d9-926b64c0c65c tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:36:10.779383 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-57484943-615d-4367-b7d9-926b64c0c65c tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] [instance: a96c633a-12f4-416c-a80c-7b3b615c0889] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:36:10.787014 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-57484943-615d-4367-b7d9-926b64c0c65c tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:10.787467 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-57484943-615d-4367-b7d9-926b64c0c65c tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:10.788265 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-57484943-615d-4367-b7d9-926b64c0c65c tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:10.788702 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-57484943-615d-4367-b7d9-926b64c0c65c tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:11.058841 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-57484943-615d-4367-b7d9-926b64c0c65c tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ddfdfeb7f4151bc84f166638123e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc445d96f85d4cf49747bf592ad9d26b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:36:11.070252 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-57484943-615d-4367-b7d9-926b64c0c65c tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] 10.222.0.66 "GET /compute/v2.1/servers/a96c633a-12f4-416c-a80c-7b3b615c0889" status: 200 len: 1318 microversion: 2.1 time: 0.296537 Jun 22 10:36:11.071573 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 542/1061] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:36:10 2022] GET /compute/v2.1/servers/a96c633a-12f4-416c-a80c-7b3b615c0889 => generated 1318 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:36:12.089540 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-17e4f1b3-337e-4039-ac49-065351097fab tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:36:12.090401 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-17e4f1b3-337e-4039-ac49-065351097fab tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] [instance: a96c633a-12f4-416c-a80c-7b3b615c0889] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:36:12.098778 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-17e4f1b3-337e-4039-ac49-065351097fab tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:12.099313 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-17e4f1b3-337e-4039-ac49-065351097fab tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:12.100175 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-17e4f1b3-337e-4039-ac49-065351097fab tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:12.100722 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-17e4f1b3-337e-4039-ac49-065351097fab tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:12.264916 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-17e4f1b3-337e-4039-ac49-065351097fab tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ddfdfeb7f4151bc84f166638123e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc445d96f85d4cf49747bf592ad9d26b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:36:12.273558 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-17e4f1b3-337e-4039-ac49-065351097fab tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] 10.222.0.66 "GET /compute/v2.1/servers/a96c633a-12f4-416c-a80c-7b3b615c0889" status: 200 len: 1318 microversion: 2.1 time: 0.188766 Jun 22 10:36:12.274154 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 520/1062] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:36:12 2022] GET /compute/v2.1/servers/a96c633a-12f4-416c-a80c-7b3b615c0889 => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:36:13.293881 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-802791d0-9302-4a30-9bcb-86252a82db76 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:36:13.294971 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-802791d0-9302-4a30-9bcb-86252a82db76 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] [instance: a96c633a-12f4-416c-a80c-7b3b615c0889] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:36:13.302481 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-802791d0-9302-4a30-9bcb-86252a82db76 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:13.302969 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-802791d0-9302-4a30-9bcb-86252a82db76 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:13.303758 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-802791d0-9302-4a30-9bcb-86252a82db76 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:13.304191 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-802791d0-9302-4a30-9bcb-86252a82db76 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:13.466138 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-bc5a9784-81fb-41f4-8225-a4ab7491f03c req-e318acce-f05a-42ba-b978-4dc26358b811 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a96c633a-12f4-416c-a80c-7b3b615c0889", "name": "network-vif-plugged", "status": "completed", "tag": "e5383603-5f8a-44a4-ac4d-f05f1f68349e"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:36:13.474549 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-802791d0-9302-4a30-9bcb-86252a82db76 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ddfdfeb7f4151bc84f166638123e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc445d96f85d4cf49747bf592ad9d26b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:36:13.483667 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-802791d0-9302-4a30-9bcb-86252a82db76 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] 10.222.0.66 "GET /compute/v2.1/servers/a96c633a-12f4-416c-a80c-7b3b615c0889" status: 200 len: 1318 microversion: 2.1 time: 0.194423 Jun 22 10:36:13.484481 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 543/1063] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:36:13 2022] GET /compute/v2.1/servers/a96c633a-12f4-416c-a80c-7b3b615c0889 => generated 1318 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:36:13.485063 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-bc5a9784-81fb-41f4-8225-a4ab7491f03c req-e318acce-f05a-42ba-b978-4dc26358b811 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:13.486172 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-bc5a9784-81fb-41f4-8225-a4ab7491f03c req-e318acce-f05a-42ba-b978-4dc26358b811 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:13.508588 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-bc5a9784-81fb-41f4-8225-a4ab7491f03c req-e318acce-f05a-42ba-b978-4dc26358b811 service nova] Creating event network-vif-plugged:e5383603-5f8a-44a4-ac4d-f05f1f68349e for instance a96c633a-12f4-416c-a80c-7b3b615c0889 on hv-cinder-84713 Jun 22 10:36:13.514092 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-bc5a9784-81fb-41f4-8225-a4ab7491f03c req-e318acce-f05a-42ba-b978-4dc26358b811 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057596 Jun 22 10:36:13.515027 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 521/1064] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:36:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:36:14.501972 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-3ecc289e-9838-4610-ba82-754027b97bcd tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:36:14.502721 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-3ecc289e-9838-4610-ba82-754027b97bcd tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] [instance: a96c633a-12f4-416c-a80c-7b3b615c0889] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:36:14.510438 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3ecc289e-9838-4610-ba82-754027b97bcd tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:14.510976 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3ecc289e-9838-4610-ba82-754027b97bcd tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:14.511817 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3ecc289e-9838-4610-ba82-754027b97bcd tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:14.512390 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-3ecc289e-9838-4610-ba82-754027b97bcd tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:14.664731 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-3ecc289e-9838-4610-ba82-754027b97bcd tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ddfdfeb7f4151bc84f166638123e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc445d96f85d4cf49747bf592ad9d26b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:36:14.673830 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-3ecc289e-9838-4610-ba82-754027b97bcd tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] 10.222.0.66 "GET /compute/v2.1/servers/a96c633a-12f4-416c-a80c-7b3b615c0889" status: 200 len: 1318 microversion: 2.1 time: 0.176048 Jun 22 10:36:14.674489 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 544/1065] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:36:14 2022] GET /compute/v2.1/servers/a96c633a-12f4-416c-a80c-7b3b615c0889 => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:36:15.689745 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_cell0:SELECT=2 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:36:15.690814 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_cell0:SELECT=6 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:36:15.696673 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-b33d5a2f-537c-450d-bc3a-35303e228829 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:36:15.697725 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-b33d5a2f-537c-450d-bc3a-35303e228829 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] [instance: a96c633a-12f4-416c-a80c-7b3b615c0889] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:36:15.706059 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b33d5a2f-537c-450d-bc3a-35303e228829 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:15.706605 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b33d5a2f-537c-450d-bc3a-35303e228829 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:15.707438 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b33d5a2f-537c-450d-bc3a-35303e228829 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:15.707982 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-b33d5a2f-537c-450d-bc3a-35303e228829 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:15.874712 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-b33d5a2f-537c-450d-bc3a-35303e228829 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ddfdfeb7f4151bc84f166638123e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc445d96f85d4cf49747bf592ad9d26b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:36:15.889114 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-b33d5a2f-537c-450d-bc3a-35303e228829 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] 10.222.0.66 "GET /compute/v2.1/servers/a96c633a-12f4-416c-a80c-7b3b615c0889" status: 200 len: 1506 microversion: 2.1 time: 0.200409 Jun 22 10:36:15.890120 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 522/1066] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:36:15 2022] GET /compute/v2.1/servers/a96c633a-12f4-416c-a80c-7b3b615c0889 => generated 1506 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:36:15.915184 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-330c4240-4b59-4f61-83c4-9135a9819406 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "98bd0bb1-f6a5-43b6-982a-bb9b09a95dad", "device": "/dev/sdb"}} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:36:15.916431 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-330c4240-4b59-4f61-83c4-9135a9819406 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] [instance: a96c633a-12f4-416c-a80c-7b3b615c0889] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:36:15.918738 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell0:SELECT=2 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:36:15.925560 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-330c4240-4b59-4f61-83c4-9135a9819406 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:15.926010 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-330c4240-4b59-4f61-83c4-9135a9819406 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:15.926849 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-330c4240-4b59-4f61-83c4-9135a9819406 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:15.927289 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-330c4240-4b59-4f61-83c4-9135a9819406 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:16.250627 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-330c4240-4b59-4f61-83c4-9135a9819406 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] 10.222.0.66 "POST /compute/v2.1/servers/a96c633a-12f4-416c-a80c-7b3b615c0889/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.339741 Jun 22 10:36:16.251377 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 545/1067] 10.222.0.66 () {60 vars in 1322 bytes} [Wed Jun 22 10:36:15 2022] POST /compute/v2.1/servers/a96c633a-12f4-416c-a80c-7b3b615c0889/os-volume_attachments => generated 194 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:36:37.921361 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-897ded58-e9a2-443b-9118-c8e66e714623 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:36:37.922097 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-897ded58-e9a2-443b-9118-c8e66e714623 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] [instance: a96c633a-12f4-416c-a80c-7b3b615c0889] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:36:37.924520 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:36:37.925320 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_cell1:SELECT=30 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:36:37.934351 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-897ded58-e9a2-443b-9118-c8e66e714623 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:37.934892 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-897ded58-e9a2-443b-9118-c8e66e714623 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:37.935857 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-897ded58-e9a2-443b-9118-c8e66e714623 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:37.936385 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-897ded58-e9a2-443b-9118-c8e66e714623 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:38.034805 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.objects.instance [None req-897ded58-e9a2-443b-9118-c8e66e714623 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lazy-loading 'services' on Instance uuid a96c633a-12f4-416c-a80c-7b3b615c0889 {{(pid=117679) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:36:38.127071 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-897ded58-e9a2-443b-9118-c8e66e714623 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] 10.222.0.66 "DELETE /compute/v2.1/servers/a96c633a-12f4-416c-a80c-7b3b615c0889/os-volume_attachments/98bd0bb1-f6a5-43b6-982a-bb9b09a95dad" status: 202 len: 0 microversion: 2.1 time: 0.209631 Jun 22 10:36:38.127735 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 523/1068] 10.222.0.66 () {58 vars in 1415 bytes} [Wed Jun 22 10:36:37 2022] DELETE /compute/v2.1/servers/a96c633a-12f4-416c-a80c-7b3b615c0889/os-volume_attachments/98bd0bb1-f6a5-43b6-982a-bb9b09a95dad => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:36:39.273442 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_api:SELECT=16 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:36:39.274704 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:36:39.280489 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-1d540bf4-66dc-4ead-b430-009c520165b0 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:36:39.281187 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-1d540bf4-66dc-4ead-b430-009c520165b0 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] [instance: a96c633a-12f4-416c-a80c-7b3b615c0889] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:36:39.290662 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1d540bf4-66dc-4ead-b430-009c520165b0 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:39.291118 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1d540bf4-66dc-4ead-b430-009c520165b0 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:39.291914 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1d540bf4-66dc-4ead-b430-009c520165b0 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:39.292353 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-1d540bf4-66dc-4ead-b430-009c520165b0 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:39.320801 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-1d540bf4-66dc-4ead-b430-009c520165b0 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] [instance: a96c633a-12f4-416c-a80c-7b3b615c0889] Going to try to terminate instance {{(pid=117680) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 10:36:39.407901 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-1d540bf4-66dc-4ead-b430-009c520165b0 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] 10.222.0.66 "DELETE /compute/v2.1/servers/a96c633a-12f4-416c-a80c-7b3b615c0889" status: 204 len: 0 microversion: 2.1 time: 0.135695 Jun 22 10:36:39.408941 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 546/1069] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Jun 22 10:36:39 2022] DELETE /compute/v2.1/servers/a96c633a-12f4-416c-a80c-7b3b615c0889 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 10:36:39.420084 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-028a5224-d698-4476-be59-18b215b88702 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:36:39.420860 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-028a5224-d698-4476-be59-18b215b88702 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] [instance: a96c633a-12f4-416c-a80c-7b3b615c0889] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:36:39.428238 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-028a5224-d698-4476-be59-18b215b88702 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:39.428695 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-028a5224-d698-4476-be59-18b215b88702 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:39.429498 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-028a5224-d698-4476-be59-18b215b88702 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:39.429967 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-028a5224-d698-4476-be59-18b215b88702 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:39.577097 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-028a5224-d698-4476-be59-18b215b88702 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ddfdfeb7f4151bc84f166638123e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc445d96f85d4cf49747bf592ad9d26b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:36:39.585412 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-028a5224-d698-4476-be59-18b215b88702 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] 10.222.0.66 "GET /compute/v2.1/servers/a96c633a-12f4-416c-a80c-7b3b615c0889" status: 200 len: 1512 microversion: 2.1 time: 0.170551 Jun 22 10:36:39.585996 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 524/1070] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:36:39 2022] GET /compute/v2.1/servers/a96c633a-12f4-416c-a80c-7b3b615c0889 => generated 1512 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:36:40.604576 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-8a2ddc19-4806-4d75-869d-609f011f85b7 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:36:40.605295 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-8a2ddc19-4806-4d75-869d-609f011f85b7 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] [instance: a96c633a-12f4-416c-a80c-7b3b615c0889] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:36:40.612330 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8a2ddc19-4806-4d75-869d-609f011f85b7 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:40.612772 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8a2ddc19-4806-4d75-869d-609f011f85b7 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:40.613592 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8a2ddc19-4806-4d75-869d-609f011f85b7 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:40.614055 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8a2ddc19-4806-4d75-869d-609f011f85b7 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:40.755509 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-8a2ddc19-4806-4d75-869d-609f011f85b7 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ddfdfeb7f4151bc84f166638123e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc445d96f85d4cf49747bf592ad9d26b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:36:40.763715 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-8a2ddc19-4806-4d75-869d-609f011f85b7 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] 10.222.0.66 "GET /compute/v2.1/servers/a96c633a-12f4-416c-a80c-7b3b615c0889" status: 200 len: 1512 microversion: 2.1 time: 0.163723 Jun 22 10:36:40.764307 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 547/1071] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:36:40 2022] GET /compute/v2.1/servers/a96c633a-12f4-416c-a80c-7b3b615c0889 => generated 1512 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:36:41.785097 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-0cd0bcfb-1ca5-4061-850f-e7f8717c6825 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:36:41.786155 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-0cd0bcfb-1ca5-4061-850f-e7f8717c6825 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] [instance: a96c633a-12f4-416c-a80c-7b3b615c0889] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:36:41.793747 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0cd0bcfb-1ca5-4061-850f-e7f8717c6825 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:41.794192 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0cd0bcfb-1ca5-4061-850f-e7f8717c6825 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:41.795007 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0cd0bcfb-1ca5-4061-850f-e7f8717c6825 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:41.795443 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0cd0bcfb-1ca5-4061-850f-e7f8717c6825 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:41.899340 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-0cd0bcfb-1ca5-4061-850f-e7f8717c6825 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '004ddfdfeb7f4151bc84f166638123e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc445d96f85d4cf49747bf592ad9d26b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:36:41.911139 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-0cd0bcfb-1ca5-4061-850f-e7f8717c6825 tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] 10.222.0.66 "GET /compute/v2.1/servers/a96c633a-12f4-416c-a80c-7b3b615c0889" status: 200 len: 1470 microversion: 2.1 time: 0.132865 Jun 22 10:36:41.913113 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 525/1072] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:36:41 2022] GET /compute/v2.1/servers/a96c633a-12f4-416c-a80c-7b3b615c0889 => generated 1470 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:36:41.953015 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-3beadbe0-30e8-4ce0-ad97-57a5aecf52e9 req-f99ea045-c4f2-4bca-adcd-474667c59b78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a96c633a-12f4-416c-a80c-7b3b615c0889", "name": "network-vif-deleted", "tag": "e5383603-5f8a-44a4-ac4d-f05f1f68349e"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:36:41.968724 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-3beadbe0-30e8-4ce0-ad97-57a5aecf52e9 req-f99ea045-c4f2-4bca-adcd-474667c59b78 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:41.969166 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-3beadbe0-30e8-4ce0-ad97-57a5aecf52e9 req-f99ea045-c4f2-4bca-adcd-474667c59b78 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:41.984948 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-3beadbe0-30e8-4ce0-ad97-57a5aecf52e9 req-f99ea045-c4f2-4bca-adcd-474667c59b78 service nova] Creating event network-vif-deleted:e5383603-5f8a-44a4-ac4d-f05f1f68349e for instance a96c633a-12f4-416c-a80c-7b3b615c0889 on hv-cinder-84713 Jun 22 10:36:41.990995 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-3beadbe0-30e8-4ce0-ad97-57a5aecf52e9 req-f99ea045-c4f2-4bca-adcd-474667c59b78 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046326 Jun 22 10:36:41.991622 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 548/1073] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:36:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:36:42.931050 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-e7d688b7-610f-4c45-9b68-983a5a9dfd3a tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:36:42.931716 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-e7d688b7-610f-4c45-9b68-983a5a9dfd3a tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] [instance: a96c633a-12f4-416c-a80c-7b3b615c0889] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:36:42.939528 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e7d688b7-610f-4c45-9b68-983a5a9dfd3a tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:42.939990 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e7d688b7-610f-4c45-9b68-983a5a9dfd3a tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:42.940818 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e7d688b7-610f-4c45-9b68-983a5a9dfd3a tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:36:42.941240 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-e7d688b7-610f-4c45-9b68-983a5a9dfd3a tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:36:42.957283 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.wsgi [None req-e7d688b7-610f-4c45-9b68-983a5a9dfd3a tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] HTTP exception thrown: Instance a96c633a-12f4-416c-a80c-7b3b615c0889 could not be found. Jun 22 10:36:42.959127 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-e7d688b7-610f-4c45-9b68-983a5a9dfd3a tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Request method failure captured: Jun 22 10:36:42.959127 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: request: GET /compute/v2.1/servers/a96c633a-12f4-416c-a80c-7b3b615c0889 HTTP/1.1 Jun 22 10:36:42.959127 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Accept: application/json Jun 22 10:36:42.959127 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Accept-Encoding: identity Jun 22 10:36:42.959127 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Connection: close Jun 22 10:36:42.959127 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Content-Length: 0 Jun 22 10:36:42.959127 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Content-Type: application/json Jun 22 10:36:42.959127 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Host: 10.222.0.66 Jun 22 10:36:42.959127 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Openstack-System-Scope: None Jun 22 10:36:42.959127 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: User-Agent: python-urllib3/1.26.9 Jun 22 10:36:42.959127 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Auth-Token: gAAAAABisvBEuFpBV2cyu0b3SaBJMcR2hYwtQdUIPP5YPFcs_pZJNb9cqCsOBbTAhBmbZ2oCeCdPXlP2hUVE9R-p_2bAZzFvm8T1zCuvz_xaxrnrA5ZA4gonzWgOGv4o10nw-vOJCB62Dzgj0LE6MCgj4vdm3t0tjifAcfsLQthc6xdPUFmC4pg Jun 22 10:36:42.959127 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Domain-Id: None Jun 22 10:36:42.959127 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Domain-Name: None Jun 22 10:36:42.959127 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Identity-Status: Confirmed Jun 22 10:36:42.959127 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Is-Admin-Project: True Jun 22 10:36:42.959127 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Domain-Id: default Jun 22 10:36:42.959127 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Domain-Name: Default Jun 22 10:36:42.959127 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Id: cc445d96f85d4cf49747bf592ad9d26b Jun 22 10:36:42.959127 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Name: tempest-VolumesSnapshotTestJSON-507012914 Jun 22 10:36:42.959127 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Role: member,reader Jun 22 10:36:42.959127 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Roles: member,reader Jun 22 10:36:42.961966 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_cc445d96f85d4cf49747bf592ad9d26b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/cc445d96f85d4cf49747bf592ad9d26b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/cc445d96f85d4cf49747bf592ad9d26b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/cc445d96f85d4cf49747bf592ad9d26b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}] Jun 22 10:36:42.961966 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Tenant: tempest-VolumesSnapshotTestJSON-507012914 Jun 22 10:36:42.961966 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Tenant-Id: cc445d96f85d4cf49747bf592ad9d26b Jun 22 10:36:42.961966 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-507012914 Jun 22 10:36:42.961966 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User: tempest-VolumesSnapshotTestJSON-507012914-project Jun 22 10:36:42.961966 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Domain-Id: default Jun 22 10:36:42.961966 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Domain-Name: Default Jun 22 10:36:42.961966 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Id: 004ddfdfeb7f4151bc84f166638123e4 Jun 22 10:36:42.961966 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Name: tempest-VolumesSnapshotTestJSON-507012914-project Jun 22 10:36:42.961966 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: method: > Jun 22 10:36:42.961966 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: exception: Instance a96c633a-12f4-416c-a80c-7b3b615c0889 could not be found. Jun 22 10:36:42.961966 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: action_args: {'id': 'a96c633a-12f4-416c-a80c-7b3b615c0889'} Jun 22 10:36:42.963410 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:36:42.963410 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:36:42.963410 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:36:42.963410 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:36:42.963410 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:36:42.963410 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:36:42.963410 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:36:42.963410 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:36:42.963410 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:36:42.963410 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:36:42.963410 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a96c633a-12f4-416c-a80c-7b3b615c0889 could not be found. Jun 22 10:36:42.963410 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:36:42.963410 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:36:42.963410 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:36:42.963410 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:36:42.963410 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:36:42.963410 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:36:42.963410 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:36:42.963410 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:36:42.963410 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:36:42.965623 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:36:42.965623 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:36:42.965623 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:36:42.965623 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:36:42.965623 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:36:42.965623 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:36:42.965623 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:36:42.965623 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a96c633a-12f4-416c-a80c-7b3b615c0889 could not be found. Jun 22 10:36:42.965623 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:36:42.965623 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:36:42.965623 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:36:42.965623 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:36:42.965623 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:36:42.965623 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:36:42.965623 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:36:42.965623 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:36:42.965623 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a96c633a-12f4-416c-a80c-7b3b615c0889 could not be found. Jun 22 10:36:42.965623 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:36:42.968237 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-e7d688b7-610f-4c45-9b68-983a5a9dfd3a tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] Returning 404 to user: Instance a96c633a-12f4-416c-a80c-7b3b615c0889 could not be found. {{(pid=117679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:36:42.968237 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-e7d688b7-610f-4c45-9b68-983a5a9dfd3a tempest-VolumesSnapshotTestJSON-507012914 tempest-VolumesSnapshotTestJSON-507012914-project] 10.222.0.66 "GET /compute/v2.1/servers/a96c633a-12f4-416c-a80c-7b3b615c0889" status: 404 len: 111 microversion: 2.1 time: 0.033966 Jun 22 10:36:42.968237 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 526/1074] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:36:42 2022] GET /compute/v2.1/servers/a96c633a-12f4-416c-a80c-7b3b615c0889 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:37:08.682328 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:37:08.683128 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:37:08.687865 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-9ac9687e-cdad-442b-a9df-a72b318de9ab tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1139371714"}} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:37:08.688520 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-9ac9687e-cdad-442b-a9df-a72b318de9ab tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] [instance: d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:37:08.696725 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9ac9687e-cdad-442b-a9df-a72b318de9ab tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:08.697176 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9ac9687e-cdad-442b-a9df-a72b318de9ab tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:08.697972 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9ac9687e-cdad-442b-a9df-a72b318de9ab tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:08.698410 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9ac9687e-cdad-442b-a9df-a72b318de9ab tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:08.873462 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.network.security_group_api [None req-9ac9687e-cdad-442b-a9df-a72b318de9ab tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Removing security group ae9bcece-751c-4f67-b425-7dd2601c7610 from port c74f0573-b6df-477d-baf7-505e6dbdf99f Jun 22 10:37:09.392796 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-9ac9687e-cdad-442b-a9df-a72b318de9ab tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] 10.222.0.66 "POST /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f/action" status: 202 len: 0 microversion: 2.1 time: 0.711772 Jun 22 10:37:09.399013 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 549/1075] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Jun 22 10:37:08 2022] POST /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f/action => generated 0 bytes in 714 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:37:09.412751 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-e951c345-8521-47c2-b3f9-45300c74c4c6 req-b643f91a-d5ea-4b83-9dbb-9edc19616eaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f", "tag": "c74f0573-b6df-477d-baf7-505e6dbdf99f"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:37:09.417253 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_api:SELECT=8 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:37:09.421197 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:37:09.451499 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-e951c345-8521-47c2-b3f9-45300c74c4c6 req-b643f91a-d5ea-4b83-9dbb-9edc19616eaf service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:09.454278 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-e951c345-8521-47c2-b3f9-45300c74c4c6 req-b643f91a-d5ea-4b83-9dbb-9edc19616eaf service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:09.487005 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-e951c345-8521-47c2-b3f9-45300c74c4c6 req-b643f91a-d5ea-4b83-9dbb-9edc19616eaf service nova] Creating event network-changed:c74f0573-b6df-477d-baf7-505e6dbdf99f for instance d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f on hv-cinder-84713 Jun 22 10:37:09.498472 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-e951c345-8521-47c2-b3f9-45300c74c4c6 req-b643f91a-d5ea-4b83-9dbb-9edc19616eaf service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089070 Jun 22 10:37:09.501046 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 527/1076] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:37:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:37:11.110116 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-b644e718-a95b-40e4-aa51-35c348e9fc1f req-44423f5a-aa70-43cd-8e8f-57ec4b883f24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f", "tag": "c74f0573-b6df-477d-baf7-505e6dbdf99f"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:37:11.111252 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-9dbc3038-c2f1-47e9-8bc2-e94d1b297202 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:37:11.111252 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-9dbc3038-c2f1-47e9-8bc2-e94d1b297202 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] [instance: d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:37:11.118946 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9dbc3038-c2f1-47e9-8bc2-e94d1b297202 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:11.119563 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-b644e718-a95b-40e4-aa51-35c348e9fc1f req-44423f5a-aa70-43cd-8e8f-57ec4b883f24 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:11.119751 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9dbc3038-c2f1-47e9-8bc2-e94d1b297202 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:11.120003 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-b644e718-a95b-40e4-aa51-35c348e9fc1f req-44423f5a-aa70-43cd-8e8f-57ec4b883f24 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:11.120355 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9dbc3038-c2f1-47e9-8bc2-e94d1b297202 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:11.120840 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-9dbc3038-c2f1-47e9-8bc2-e94d1b297202 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:11.135586 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-b644e718-a95b-40e4-aa51-35c348e9fc1f req-44423f5a-aa70-43cd-8e8f-57ec4b883f24 service nova] Creating event network-changed:c74f0573-b6df-477d-baf7-505e6dbdf99f for instance d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f on hv-cinder-84713 Jun 22 10:37:11.142401 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-b644e718-a95b-40e4-aa51-35c348e9fc1f req-44423f5a-aa70-43cd-8e8f-57ec4b883f24 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036209 Jun 22 10:37:11.143450 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 528/1077] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:37:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:37:11.247978 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.objects.instance [None req-9dbc3038-c2f1-47e9-8bc2-e94d1b297202 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lazy-loading 'services' on Instance uuid d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f {{(pid=117680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:37:11.400043 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-9dbc3038-c2f1-47e9-8bc2-e94d1b297202 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] 10.222.0.66 "DELETE /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f/os-volume_attachments/af13d548-164b-46a8-a609-9c7b27bd2a60" status: 202 len: 0 microversion: 2.1 time: 0.294893 Jun 22 10:37:11.401402 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 550/1078] 10.222.0.66 () {58 vars in 1415 bytes} [Wed Jun 22 10:37:11 2022] DELETE /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f/os-volume_attachments/af13d548-164b-46a8-a609-9c7b27bd2a60 => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:37:11.417632 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-551d3c0b-66a2-4f40-938c-3ced002c5f99 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:37:11.419506 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-551d3c0b-66a2-4f40-938c-3ced002c5f99 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] [instance: d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:37:11.440684 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-551d3c0b-66a2-4f40-938c-3ced002c5f99 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:11.441960 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-551d3c0b-66a2-4f40-938c-3ced002c5f99 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:11.443085 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-551d3c0b-66a2-4f40-938c-3ced002c5f99 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:11.445046 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-551d3c0b-66a2-4f40-938c-3ced002c5f99 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:11.512147 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-551d3c0b-66a2-4f40-938c-3ced002c5f99 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] 10.222.0.66 "GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102951 Jun 22 10:37:11.513474 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 529/1079] 10.222.0.66 () {58 vars in 1301 bytes} [Wed Jun 22 10:37:11 2022] GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:37:12.535494 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-ac84325a-2d62-439d-b7d4-1641d9717c91 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:37:12.537566 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-ac84325a-2d62-439d-b7d4-1641d9717c91 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] [instance: d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:37:12.550123 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ac84325a-2d62-439d-b7d4-1641d9717c91 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:12.550944 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ac84325a-2d62-439d-b7d4-1641d9717c91 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:12.551823 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ac84325a-2d62-439d-b7d4-1641d9717c91 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:12.552366 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ac84325a-2d62-439d-b7d4-1641d9717c91 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:12.591954 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-ac84325a-2d62-439d-b7d4-1641d9717c91 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] 10.222.0.66 "GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.067144 Jun 22 10:37:12.592547 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 551/1080] 10.222.0.66 () {58 vars in 1301 bytes} [Wed Jun 22 10:37:12 2022] GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f/os-volume_attachments => generated 25 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 22 10:37:12.603495 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-7c46d9a8-c148-4544-9b92-60fa4551611f tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:37:12.604623 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-7c46d9a8-c148-4544-9b92-60fa4551611f tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] [instance: d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:37:12.611867 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7c46d9a8-c148-4544-9b92-60fa4551611f tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:12.612311 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7c46d9a8-c148-4544-9b92-60fa4551611f tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:12.613109 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7c46d9a8-c148-4544-9b92-60fa4551611f tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:12.613633 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-7c46d9a8-c148-4544-9b92-60fa4551611f tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:12.715873 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.wsgi [None req-7c46d9a8-c148-4544-9b92-60fa4551611f tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] HTTP exception thrown: Instance d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f is not attached to volume af13d548-164b-46a8-a609-9c7b27bd2a60 Jun 22 10:37:12.719128 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-7c46d9a8-c148-4544-9b92-60fa4551611f tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Request method failure captured: Jun 22 10:37:12.719128 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: request: DELETE /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f/os-volume_attachments/af13d548-164b-46a8-a609-9c7b27bd2a60 HTTP/1.1 Jun 22 10:37:12.719128 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Accept: application/json Jun 22 10:37:12.719128 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Accept-Encoding: identity Jun 22 10:37:12.719128 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Connection: close Jun 22 10:37:12.719128 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Content-Length: 0 Jun 22 10:37:12.719128 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Content-Type: application/json Jun 22 10:37:12.719128 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Host: 10.222.0.66 Jun 22 10:37:12.719128 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Openstack-System-Scope: None Jun 22 10:37:12.719128 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: User-Agent: python-urllib3/1.26.9 Jun 22 10:37:12.719128 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Auth-Token: gAAAAABisu_WF-FXOyjpK2NvBsqcaWgVmjgUoekGHEKv3iSipmvzMvzK_dpMo54MQGQtpDw3tpISF_1Bb0vvsWbu_KFCCTk2OpuekV4i_bh0nR5QoUGOL5aiBmdK-XOdYFdxVOJfrsojJ0TSnfiGSY-S9URcd99PUenNfC7vRnC0tb3SYLwX-Mc Jun 22 10:37:12.719128 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Domain-Id: None Jun 22 10:37:12.719128 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Domain-Name: None Jun 22 10:37:12.719128 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Identity-Status: Confirmed Jun 22 10:37:12.719128 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Is-Admin-Project: True Jun 22 10:37:12.719128 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Domain-Id: default Jun 22 10:37:12.719128 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Domain-Name: Default Jun 22 10:37:12.719128 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Id: 0ead3712348245f8862718ef0e30b3c0 Jun 22 10:37:12.719128 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Name: tempest-TestMinimumBasicScenario-589531650 Jun 22 10:37:12.719128 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Role: member,reader Jun 22 10:37:12.719128 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Roles: member,reader Jun 22 10:37:12.723232 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_0ead3712348245f8862718ef0e30b3c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0ead3712348245f8862718ef0e30b3c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/0ead3712348245f8862718ef0e30b3c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0ead3712348245f8862718ef0e30b3c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}] Jun 22 10:37:12.723232 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Tenant: tempest-TestMinimumBasicScenario-589531650 Jun 22 10:37:12.723232 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Tenant-Id: 0ead3712348245f8862718ef0e30b3c0 Jun 22 10:37:12.723232 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Tenant-Name: tempest-TestMinimumBasicScenario-589531650 Jun 22 10:37:12.723232 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User: tempest-TestMinimumBasicScenario-589531650-project Jun 22 10:37:12.723232 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Domain-Id: default Jun 22 10:37:12.723232 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Domain-Name: Default Jun 22 10:37:12.723232 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Id: 172df9a596fd4729967f3787533ea57d Jun 22 10:37:12.723232 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Name: tempest-TestMinimumBasicScenario-589531650-project Jun 22 10:37:12.723232 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: method: > Jun 22 10:37:12.723232 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: exception: Instance d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f is not attached to volume af13d548-164b-46a8-a609-9c7b27bd2a60 Jun 22 10:37:12.724048 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: action_args: {'server_id': 'd3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f', 'id': 'af13d548-164b-46a8-a609-9c7b27bd2a60'} Jun 22 10:37:12.724048 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:37:12.724048 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:37:12.724048 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 22 10:37:12.724048 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 22 10:37:12.724048 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 22 10:37:12.724048 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 22 10:37:12.724048 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 22 10:37:12.724048 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 22 10:37:12.724048 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id af13d548-164b-46a8-a609-9c7b27bd2a60. Jun 22 10:37:12.724048 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:37:12.724048 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:37:12.724048 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:37:12.724048 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:37:12.724048 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:37:12.724048 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:37:12.724048 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:37:12.724048 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:37:12.724048 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:37:12.725445 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:37:12.725445 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 22 10:37:12.725445 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 22 10:37:12.725445 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f is not attached to volume af13d548-164b-46a8-a609-9c7b27bd2a60 Jun 22 10:37:12.725445 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:37:12.725445 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:37:12.725445 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:37:12.725445 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:37:12.725445 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:37:12.725445 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:37:12.725445 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:37:12.725445 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:37:12.725445 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f is not attached to volume af13d548-164b-46a8-a609-9c7b27bd2a60 Jun 22 10:37:12.725445 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:37:12.725445 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-7c46d9a8-c148-4544-9b92-60fa4551611f tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Returning 404 to user: Instance d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f is not attached to volume af13d548-164b-46a8-a609-9c7b27bd2a60 {{(pid=117679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:37:12.726445 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-7c46d9a8-c148-4544-9b92-60fa4551611f tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] 10.222.0.66 "DELETE /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f/os-volume_attachments/af13d548-164b-46a8-a609-9c7b27bd2a60" status: 404 len: 154 microversion: 2.1 time: 0.121579 Jun 22 10:37:12.726445 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 530/1081] 10.222.0.66 () {58 vars in 1415 bytes} [Wed Jun 22 10:37:12 2022] DELETE /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f/os-volume_attachments/af13d548-164b-46a8-a609-9c7b27bd2a60 => generated 154 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:37:13.931453 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-a869fe42-6619-46a1-812b-6d1957a18105 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:37:13.932108 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-a869fe42-6619-46a1-812b-6d1957a18105 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] [instance: d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:37:13.942437 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a869fe42-6619-46a1-812b-6d1957a18105 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:13.943226 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a869fe42-6619-46a1-812b-6d1957a18105 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:13.945515 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a869fe42-6619-46a1-812b-6d1957a18105 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:13.945850 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a869fe42-6619-46a1-812b-6d1957a18105 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:13.978190 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-a869fe42-6619-46a1-812b-6d1957a18105 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] [instance: d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f] Going to try to terminate instance {{(pid=117680) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 10:37:14.094626 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-a869fe42-6619-46a1-812b-6d1957a18105 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] 10.222.0.66 "DELETE /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f" status: 204 len: 0 microversion: 2.1 time: 0.166998 Jun 22 10:37:14.098619 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 552/1082] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Jun 22 10:37:13 2022] DELETE /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 10:37:14.104688 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-f65fca3b-5d8b-4e1f-946f-4fda61fe0107 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:37:14.106016 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-f65fca3b-5d8b-4e1f-946f-4fda61fe0107 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] [instance: d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:37:14.113176 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f65fca3b-5d8b-4e1f-946f-4fda61fe0107 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:14.113626 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f65fca3b-5d8b-4e1f-946f-4fda61fe0107 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:14.114580 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f65fca3b-5d8b-4e1f-946f-4fda61fe0107 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:14.114889 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-f65fca3b-5d8b-4e1f-946f-4fda61fe0107 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:14.693916 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-f65fca3b-5d8b-4e1f-946f-4fda61fe0107 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172df9a596fd4729967f3787533ea57d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ead3712348245f8862718ef0e30b3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:37:14.705388 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-f65fca3b-5d8b-4e1f-946f-4fda61fe0107 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] 10.222.0.66 "GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f" status: 200 len: 1553 microversion: 2.1 time: 0.605236 Jun 22 10:37:14.706242 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 531/1083] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:37:14 2022] GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f => generated 1553 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:37:15.724996 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-5fc8cfc4-7c61-4e60-992f-f143cc52a74d tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:37:15.725874 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-5fc8cfc4-7c61-4e60-992f-f143cc52a74d tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] [instance: d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:37:15.733416 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5fc8cfc4-7c61-4e60-992f-f143cc52a74d tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:15.734223 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5fc8cfc4-7c61-4e60-992f-f143cc52a74d tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:15.735116 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5fc8cfc4-7c61-4e60-992f-f143cc52a74d tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:15.735736 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5fc8cfc4-7c61-4e60-992f-f143cc52a74d tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:15.950352 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-5fc8cfc4-7c61-4e60-992f-f143cc52a74d tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172df9a596fd4729967f3787533ea57d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ead3712348245f8862718ef0e30b3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:37:15.964151 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-5fc8cfc4-7c61-4e60-992f-f143cc52a74d tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] 10.222.0.66 "GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f" status: 200 len: 1553 microversion: 2.1 time: 0.243462 Jun 22 10:37:15.972586 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 553/1084] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:37:15 2022] GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f => generated 1553 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:37:16.711618 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-e1637919-7b23-4caa-8fea-0ed61b2b2a5f req-3dceb2b3-c1c4-4576-87d1-0a39aadd81e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f", "name": "network-vif-deleted", "tag": "c74f0573-b6df-477d-baf7-505e6dbdf99f"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:37:16.724030 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-e1637919-7b23-4caa-8fea-0ed61b2b2a5f req-3dceb2b3-c1c4-4576-87d1-0a39aadd81e5 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:16.724598 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-e1637919-7b23-4caa-8fea-0ed61b2b2a5f req-3dceb2b3-c1c4-4576-87d1-0a39aadd81e5 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:16.757900 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-e1637919-7b23-4caa-8fea-0ed61b2b2a5f req-3dceb2b3-c1c4-4576-87d1-0a39aadd81e5 service nova] Creating event network-vif-deleted:c74f0573-b6df-477d-baf7-505e6dbdf99f for instance d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f on hv-cinder-84713 Jun 22 10:37:16.767759 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-e1637919-7b23-4caa-8fea-0ed61b2b2a5f req-3dceb2b3-c1c4-4576-87d1-0a39aadd81e5 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059737 Jun 22 10:37:16.774491 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 532/1085] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:37:16.989957 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-74dd40f4-7105-4587-a586-5fed45044985 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:37:16.991971 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-74dd40f4-7105-4587-a586-5fed45044985 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] [instance: d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:37:17.002581 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-74dd40f4-7105-4587-a586-5fed45044985 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:17.003407 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-74dd40f4-7105-4587-a586-5fed45044985 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:17.006088 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-74dd40f4-7105-4587-a586-5fed45044985 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:17.006624 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-74dd40f4-7105-4587-a586-5fed45044985 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:17.068957 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-74dd40f4-7105-4587-a586-5fed45044985 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:17.069652 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-74dd40f4-7105-4587-a586-5fed45044985 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:17.070294 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.objects.instance [None req-74dd40f4-7105-4587-a586-5fed45044985 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lazy-loading 'fault' on Instance uuid d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f {{(pid=117680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:37:17.168895 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-74dd40f4-7105-4587-a586-5fed45044985 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172df9a596fd4729967f3787533ea57d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ead3712348245f8862718ef0e30b3c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:37:17.199777 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-74dd40f4-7105-4587-a586-5fed45044985 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] 10.222.0.66 "GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f" status: 200 len: 1348 microversion: 2.1 time: 0.213986 Jun 22 10:37:17.203580 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 554/1086] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:37:16 2022] GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f => generated 1348 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:37:18.238001 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-68ef6f88-597d-444d-9b08-02c8a37ace46 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:37:18.241550 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-68ef6f88-597d-444d-9b08-02c8a37ace46 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] [instance: d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:37:18.258698 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-68ef6f88-597d-444d-9b08-02c8a37ace46 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:18.259483 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-68ef6f88-597d-444d-9b08-02c8a37ace46 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:18.261928 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-68ef6f88-597d-444d-9b08-02c8a37ace46 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:18.263181 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-68ef6f88-597d-444d-9b08-02c8a37ace46 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:18.290925 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.wsgi [None req-68ef6f88-597d-444d-9b08-02c8a37ace46 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] HTTP exception thrown: Instance d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f could not be found. Jun 22 10:37:18.295394 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-68ef6f88-597d-444d-9b08-02c8a37ace46 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Request method failure captured: Jun 22 10:37:18.295394 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: request: GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f HTTP/1.1 Jun 22 10:37:18.295394 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Accept: application/json Jun 22 10:37:18.295394 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Accept-Encoding: identity Jun 22 10:37:18.295394 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Connection: close Jun 22 10:37:18.295394 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Content-Length: 0 Jun 22 10:37:18.295394 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Content-Type: application/json Jun 22 10:37:18.295394 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Host: 10.222.0.66 Jun 22 10:37:18.295394 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Openstack-System-Scope: None Jun 22 10:37:18.295394 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: User-Agent: python-urllib3/1.26.9 Jun 22 10:37:18.295394 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Auth-Token: gAAAAABisu_WF-FXOyjpK2NvBsqcaWgVmjgUoekGHEKv3iSipmvzMvzK_dpMo54MQGQtpDw3tpISF_1Bb0vvsWbu_KFCCTk2OpuekV4i_bh0nR5QoUGOL5aiBmdK-XOdYFdxVOJfrsojJ0TSnfiGSY-S9URcd99PUenNfC7vRnC0tb3SYLwX-Mc Jun 22 10:37:18.295394 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Domain-Id: None Jun 22 10:37:18.295394 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Domain-Name: None Jun 22 10:37:18.295394 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Identity-Status: Confirmed Jun 22 10:37:18.295394 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Is-Admin-Project: True Jun 22 10:37:18.295394 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Domain-Id: default Jun 22 10:37:18.295394 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Domain-Name: Default Jun 22 10:37:18.295394 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Id: 0ead3712348245f8862718ef0e30b3c0 Jun 22 10:37:18.295394 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Name: tempest-TestMinimumBasicScenario-589531650 Jun 22 10:37:18.295394 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Role: member,reader Jun 22 10:37:18.295394 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Roles: member,reader Jun 22 10:37:18.298625 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_0ead3712348245f8862718ef0e30b3c0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0ead3712348245f8862718ef0e30b3c0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/0ead3712348245f8862718ef0e30b3c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0ead3712348245f8862718ef0e30b3c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}] Jun 22 10:37:18.298625 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Tenant: tempest-TestMinimumBasicScenario-589531650 Jun 22 10:37:18.298625 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Tenant-Id: 0ead3712348245f8862718ef0e30b3c0 Jun 22 10:37:18.298625 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Tenant-Name: tempest-TestMinimumBasicScenario-589531650 Jun 22 10:37:18.298625 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User: tempest-TestMinimumBasicScenario-589531650-project Jun 22 10:37:18.298625 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Domain-Id: default Jun 22 10:37:18.298625 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Domain-Name: Default Jun 22 10:37:18.298625 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Id: 172df9a596fd4729967f3787533ea57d Jun 22 10:37:18.298625 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Name: tempest-TestMinimumBasicScenario-589531650-project Jun 22 10:37:18.298625 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: method: > Jun 22 10:37:18.298625 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: exception: Instance d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f could not be found. Jun 22 10:37:18.298625 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: action_args: {'id': 'd3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f'} Jun 22 10:37:18.300307 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:37:18.300307 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:37:18.300307 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:37:18.300307 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:37:18.300307 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:37:18.300307 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:37:18.300307 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:37:18.300307 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:37:18.300307 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:37:18.300307 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:37:18.300307 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f could not be found. Jun 22 10:37:18.300307 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:37:18.300307 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:37:18.300307 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:37:18.300307 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:37:18.300307 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:37:18.300307 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:37:18.300307 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:37:18.300307 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:37:18.300307 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:37:18.303910 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:37:18.303910 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:37:18.303910 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:37:18.303910 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:37:18.303910 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:37:18.303910 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:37:18.303910 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:37:18.303910 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f could not be found. Jun 22 10:37:18.303910 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:37:18.303910 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:37:18.303910 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:37:18.303910 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:37:18.303910 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:37:18.303910 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:37:18.303910 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:37:18.303910 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:37:18.303910 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f could not be found. Jun 22 10:37:18.303910 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:37:18.316922 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-68ef6f88-597d-444d-9b08-02c8a37ace46 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Returning 404 to user: Instance d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f could not be found. {{(pid=117679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:37:18.316922 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-68ef6f88-597d-444d-9b08-02c8a37ace46 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] 10.222.0.66 "GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f" status: 404 len: 111 microversion: 2.1 time: 0.080190 Jun 22 10:37:18.316922 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 533/1087] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:37:18 2022] GET /compute/v2.1/servers/d3e48d61-6a4e-44b7-9ce5-c78dc75d9a1f => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:37:18.324155 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-f2444d8e-1de1-4829-ba91-2e6ca450e445 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] Calling method '.version_select at 0x7f60d96cde50>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:37:18.360430 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-f2444d8e-1de1-4829-ba91-2e6ca450e445 tempest-TestMinimumBasicScenario-589531650 tempest-TestMinimumBasicScenario-589531650-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-388445002" status: 202 len: 0 microversion: 2.1 time: 0.043553 Jun 22 10:37:18.361272 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 555/1088] 10.222.0.66 () {58 vars in 1268 bytes} [Wed Jun 22 10:37:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-388445002 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:37:25.659147 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-b3b06352-83c2-44ce-a1b2-3c773727814b tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Action: 'create', calling method: .version_select at 0x7f60da1a4ca0>, body: {"keypair": {"name": "tempest-TestShelveInstance-248844381", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGnnnDoABlzBvyGHe0IE457gQQ+KzOvGWS6Sbbkyp3nj2YsA/aKdHgb2oDpXL/vtqsa+UGAhVxosuzN+kOzfPfhh7tnC80c2rT9h8XCHjJCW39bESO6qXctOmhVnMaqyeA=="}} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:37:25.697246 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.quota [None req-b3b06352-83c2-44ce-a1b2-3c773727814b tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Getting quotas for project d51887577477404e9595e11feff3da23. Resources: {'key_pairs'} {{(pid=117679) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:37:25.703334 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.quota [None req-b3b06352-83c2-44ce-a1b2-3c773727814b tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Getting quotas for user 2bed25916e1a4c05a671992fe8f0d675 and project d51887577477404e9595e11feff3da23. Resources: {'key_pairs'} {{(pid=117679) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:37:25.747718 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-b3b06352-83c2-44ce-a1b2-3c773727814b tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.501181 Jun 22 10:37:25.748770 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 534/1089] 10.222.0.66 () {60 vars in 1158 bytes} [Wed Jun 22 10:37:25 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:37:39.103313 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 10:37:39.103951 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Wed Jun 22 10:37:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 10:37:50.712968 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:37:50.713781 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:37:50.718189 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-cb1af308-212e-4025-8e54-e663b86a15cf tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1104121049", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-248844381", "security_groups": [{"name": "tempest-secgroup-smoke-555277754"}], "networks": [{"uuid": "c613014e-8485-4a10-9ea8-a35b46576fd3"}], "block_device_mapping_v2": [{"uuid": "e70453b9-e0da-44f6-9a6c-d006075c6099", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:37:50.862689 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.network.neutron [None req-cb1af308-212e-4025-8e54-e663b86a15cf tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] validate_networks() for [('c613014e-8485-4a10-9ea8-a35b46576fd3', None, None, None, None, None)] {{(pid=117680) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 22 10:37:51.317866 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-cb1af308-212e-4025-8e54-e663b86a15cf tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Flavor limits 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 22 10:37:51.318607 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-cb1af308-212e-4025-8e54-e663b86a15cf tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Image limits 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 22 10:37:51.319215 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-cb1af308-212e-4025-8e54-e663b86a15cf tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Flavor pref 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 22 10:37:51.319757 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-cb1af308-212e-4025-8e54-e663b86a15cf tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Image pref 0:0:0 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 22 10:37:51.320289 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.virt.hardware [None req-cb1af308-212e-4025-8e54-e663b86a15cf tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117680) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 22 10:37:51.330565 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-cb1af308-212e-4025-8e54-e663b86a15cf tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:51.330998 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-cb1af308-212e-4025-8e54-e663b86a15cf tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:51.331866 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-cb1af308-212e-4025-8e54-e663b86a15cf tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:51.332296 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-cb1af308-212e-4025-8e54-e663b86a15cf tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:51.351379 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.quota [None req-cb1af308-212e-4025-8e54-e663b86a15cf tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Getting quotas for project d51887577477404e9595e11feff3da23. Resources: {'instances', 'cores', 'ram'} {{(pid=117680) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 22 10:37:51.356122 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.quota [None req-cb1af308-212e-4025-8e54-e663b86a15cf tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Getting quotas for user 2bed25916e1a4c05a671992fe8f0d675 and project d51887577477404e9595e11feff3da23. Resources: {'instances', 'cores', 'ram'} {{(pid=117680) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 22 10:37:51.420423 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-cb1af308-212e-4025-8e54-e663b86a15cf tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Going to run 1 instances... {{(pid=117680) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 22 10:37:51.422711 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-cb1af308-212e-4025-8e54-e663b86a15cf tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] [instance: fb5c83d8-77a0-4ea2-b589-783e1a097f63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e70453b9-e0da-44f6-9a6c-d006075c6099',volume_size=None,volume_type=None)] {{(pid=117680) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 22 10:37:51.580437 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-cb1af308-212e-4025-8e54-e663b86a15cf tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.868371 Jun 22 10:37:51.581484 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 556/1090] 10.222.0.66 () {60 vars in 1146 bytes} [Wed Jun 22 10:37:50 2022] POST /compute/v2.1/servers => generated 405 bytes in 871 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 22 10:37:51.592384 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_cell1:SELECT=26 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:37:51.594269 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_cell0:SELECT=4 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:37:51.595397 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=1 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:37:51.604517 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-76cf4d30-ef28-43a2-9e56-0db11acf8f29 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:37:51.605639 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-76cf4d30-ef28-43a2-9e56-0db11acf8f29 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] [instance: fb5c83d8-77a0-4ea2-b589-783e1a097f63] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:37:51.705242 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-76cf4d30-ef28-43a2-9e56-0db11acf8f29 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed25916e1a4c05a671992fe8f0d675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51887577477404e9595e11feff3da23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:37:51.717067 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-76cf4d30-ef28-43a2-9e56-0db11acf8f29 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] 10.222.0.66 "GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63" status: 200 len: 1088 microversion: 2.1 time: 0.125783 Jun 22 10:37:51.718123 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 535/1091] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:37:51 2022] GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63 => generated 1088 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:37:52.740417 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-c19458ef-9e10-4d4a-b498-31db9363de56 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:37:52.744378 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-c19458ef-9e10-4d4a-b498-31db9363de56 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] [instance: fb5c83d8-77a0-4ea2-b589-783e1a097f63] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:37:52.756399 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-c19458ef-9e10-4d4a-b498-31db9363de56 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:52.757229 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-c19458ef-9e10-4d4a-b498-31db9363de56 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:52.758732 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-c19458ef-9e10-4d4a-b498-31db9363de56 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:52.760177 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-c19458ef-9e10-4d4a-b498-31db9363de56 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:52.911650 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-c19458ef-9e10-4d4a-b498-31db9363de56 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed25916e1a4c05a671992fe8f0d675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51887577477404e9595e11feff3da23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:37:52.920300 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-c19458ef-9e10-4d4a-b498-31db9363de56 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] 10.222.0.66 "GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63" status: 200 len: 1204 microversion: 2.1 time: 0.188247 Jun 22 10:37:52.921767 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 557/1092] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:37:52 2022] GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63 => generated 1204 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:37:53.942755 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-5dc846d4-0454-4b29-9138-612d0fb23773 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:37:53.943939 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-5dc846d4-0454-4b29-9138-612d0fb23773 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] [instance: fb5c83d8-77a0-4ea2-b589-783e1a097f63] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:37:53.956676 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5dc846d4-0454-4b29-9138-612d0fb23773 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:53.957522 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5dc846d4-0454-4b29-9138-612d0fb23773 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:53.958943 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5dc846d4-0454-4b29-9138-612d0fb23773 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:53.959693 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5dc846d4-0454-4b29-9138-612d0fb23773 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:54.209696 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-5dc846d4-0454-4b29-9138-612d0fb23773 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed25916e1a4c05a671992fe8f0d675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51887577477404e9595e11feff3da23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:37:54.223739 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-5dc846d4-0454-4b29-9138-612d0fb23773 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] 10.222.0.66 "GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63" status: 200 len: 1259 microversion: 2.1 time: 0.288353 Jun 22 10:37:54.224787 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 536/1093] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:37:53 2022] GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63 => generated 1259 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:37:54.548764 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-cdcac5b9-cfce-42e0-a124-20a53d8f012a req-e2919b3d-7bc7-4a07-ae27-4ded50f9eac5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb5c83d8-77a0-4ea2-b589-783e1a097f63", "tag": "a2eae374-e3ba-47c3-86c8-1a2f361f6348"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:37:54.586559 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-cdcac5b9-cfce-42e0-a124-20a53d8f012a req-e2919b3d-7bc7-4a07-ae27-4ded50f9eac5 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:54.595841 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-cdcac5b9-cfce-42e0-a124-20a53d8f012a req-e2919b3d-7bc7-4a07-ae27-4ded50f9eac5 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:54.623833 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-cdcac5b9-cfce-42e0-a124-20a53d8f012a req-e2919b3d-7bc7-4a07-ae27-4ded50f9eac5 service nova] Creating event network-changed:a2eae374-e3ba-47c3-86c8-1a2f361f6348 for instance fb5c83d8-77a0-4ea2-b589-783e1a097f63 on hv-cinder-84713 Jun 22 10:37:54.636865 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-cdcac5b9-cfce-42e0-a124-20a53d8f012a req-e2919b3d-7bc7-4a07-ae27-4ded50f9eac5 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094044 Jun 22 10:37:54.638712 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 558/1094] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:37:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:37:55.250267 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-6204a435-15d0-4963-9a2a-78ddd4325a66 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:37:55.251230 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-6204a435-15d0-4963-9a2a-78ddd4325a66 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] [instance: fb5c83d8-77a0-4ea2-b589-783e1a097f63] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:37:55.259866 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6204a435-15d0-4963-9a2a-78ddd4325a66 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:55.260469 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6204a435-15d0-4963-9a2a-78ddd4325a66 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:55.261388 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6204a435-15d0-4963-9a2a-78ddd4325a66 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:55.261964 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-6204a435-15d0-4963-9a2a-78ddd4325a66 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:55.488384 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-6204a435-15d0-4963-9a2a-78ddd4325a66 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed25916e1a4c05a671992fe8f0d675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51887577477404e9595e11feff3da23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:37:55.499369 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-6204a435-15d0-4963-9a2a-78ddd4325a66 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] 10.222.0.66 "GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63" status: 200 len: 1259 microversion: 2.1 time: 0.253313 Jun 22 10:37:55.500480 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 537/1095] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:37:55 2022] GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63 => generated 1259 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:37:56.523233 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-2576e672-2588-40a1-8d5f-73ab7308d8b7 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:37:56.524409 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-2576e672-2588-40a1-8d5f-73ab7308d8b7 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] [instance: fb5c83d8-77a0-4ea2-b589-783e1a097f63] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:37:56.536239 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2576e672-2588-40a1-8d5f-73ab7308d8b7 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:56.537002 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2576e672-2588-40a1-8d5f-73ab7308d8b7 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:56.538351 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2576e672-2588-40a1-8d5f-73ab7308d8b7 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:56.539126 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2576e672-2588-40a1-8d5f-73ab7308d8b7 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:56.792505 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-2576e672-2588-40a1-8d5f-73ab7308d8b7 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed25916e1a4c05a671992fe8f0d675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51887577477404e9595e11feff3da23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:37:56.801997 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-2576e672-2588-40a1-8d5f-73ab7308d8b7 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] 10.222.0.66 "GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63" status: 200 len: 1259 microversion: 2.1 time: 0.287453 Jun 22 10:37:56.802891 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 559/1096] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:37:56 2022] GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63 => generated 1259 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:37:57.825614 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-4e76acfc-61a0-4d11-b7ed-6f08abbdb365 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:37:57.826292 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-4e76acfc-61a0-4d11-b7ed-6f08abbdb365 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] [instance: fb5c83d8-77a0-4ea2-b589-783e1a097f63] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:37:57.834277 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4e76acfc-61a0-4d11-b7ed-6f08abbdb365 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:57.834788 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4e76acfc-61a0-4d11-b7ed-6f08abbdb365 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:57.835594 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4e76acfc-61a0-4d11-b7ed-6f08abbdb365 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:57.836080 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4e76acfc-61a0-4d11-b7ed-6f08abbdb365 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:58.012407 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-4e76acfc-61a0-4d11-b7ed-6f08abbdb365 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed25916e1a4c05a671992fe8f0d675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51887577477404e9595e11feff3da23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:37:58.020825 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-4e76acfc-61a0-4d11-b7ed-6f08abbdb365 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] 10.222.0.66 "GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63" status: 200 len: 1259 microversion: 2.1 time: 0.199625 Jun 22 10:37:58.021531 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 538/1097] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:37:57 2022] GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63 => generated 1259 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:37:59.038724 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-6d24ac46-d492-4b87-a45f-cd9a24248b4a tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:37:59.039372 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-6d24ac46-d492-4b87-a45f-cd9a24248b4a tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] [instance: fb5c83d8-77a0-4ea2-b589-783e1a097f63] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:37:59.046961 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6d24ac46-d492-4b87-a45f-cd9a24248b4a tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:59.047359 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6d24ac46-d492-4b87-a45f-cd9a24248b4a tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:59.048152 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6d24ac46-d492-4b87-a45f-cd9a24248b4a tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:37:59.048600 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6d24ac46-d492-4b87-a45f-cd9a24248b4a tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:37:59.219679 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-6d24ac46-d492-4b87-a45f-cd9a24248b4a tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed25916e1a4c05a671992fe8f0d675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51887577477404e9595e11feff3da23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:37:59.228480 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-6d24ac46-d492-4b87-a45f-cd9a24248b4a tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] 10.222.0.66 "GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63" status: 200 len: 1259 microversion: 2.1 time: 0.193774 Jun 22 10:37:59.229095 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 560/1098] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:37:59 2022] GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63 => generated 1259 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:38:00.246411 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-5729dbab-9ba4-40b6-8e8a-5d83a9a089a9 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:38:00.247172 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-5729dbab-9ba4-40b6-8e8a-5d83a9a089a9 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] [instance: fb5c83d8-77a0-4ea2-b589-783e1a097f63] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:38:00.254836 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5729dbab-9ba4-40b6-8e8a-5d83a9a089a9 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:38:00.255297 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5729dbab-9ba4-40b6-8e8a-5d83a9a089a9 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:38:00.256105 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5729dbab-9ba4-40b6-8e8a-5d83a9a089a9 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:38:00.256550 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-5729dbab-9ba4-40b6-8e8a-5d83a9a089a9 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:38:00.411524 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-5729dbab-9ba4-40b6-8e8a-5d83a9a089a9 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed25916e1a4c05a671992fe8f0d675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51887577477404e9595e11feff3da23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:38:00.420248 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-5729dbab-9ba4-40b6-8e8a-5d83a9a089a9 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] 10.222.0.66 "GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63" status: 200 len: 1259 microversion: 2.1 time: 0.178028 Jun 22 10:38:00.420914 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 539/1099] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:38:00 2022] GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63 => generated 1259 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:38:01.438473 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-6e5255d3-1255-435a-bd37-9a2cbe5df12e tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:38:01.439218 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-6e5255d3-1255-435a-bd37-9a2cbe5df12e tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] [instance: fb5c83d8-77a0-4ea2-b589-783e1a097f63] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:38:01.441934 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell0:SELECT=2 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:38:01.442754 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell0:SELECT=6 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:38:01.450395 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6e5255d3-1255-435a-bd37-9a2cbe5df12e tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:38:01.450932 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6e5255d3-1255-435a-bd37-9a2cbe5df12e tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:38:01.451711 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6e5255d3-1255-435a-bd37-9a2cbe5df12e tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:38:01.452165 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6e5255d3-1255-435a-bd37-9a2cbe5df12e tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:38:01.606962 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-6e5255d3-1255-435a-bd37-9a2cbe5df12e tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed25916e1a4c05a671992fe8f0d675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51887577477404e9595e11feff3da23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:38:01.615266 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-6e5255d3-1255-435a-bd37-9a2cbe5df12e tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] 10.222.0.66 "GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63" status: 200 len: 1259 microversion: 2.1 time: 0.180758 Jun 22 10:38:01.615864 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 561/1100] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:38:01 2022] GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63 => generated 1259 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:38:02.635283 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-1496e4f7-c889-4945-a6e2-30e8f5b0c49c tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:38:02.636643 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-1496e4f7-c889-4945-a6e2-30e8f5b0c49c tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] [instance: fb5c83d8-77a0-4ea2-b589-783e1a097f63] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:38:02.640440 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_cell0:SELECT=2 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:38:02.648890 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1496e4f7-c889-4945-a6e2-30e8f5b0c49c tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:38:02.649338 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1496e4f7-c889-4945-a6e2-30e8f5b0c49c tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:38:02.650135 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1496e4f7-c889-4945-a6e2-30e8f5b0c49c tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:38:02.650595 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1496e4f7-c889-4945-a6e2-30e8f5b0c49c tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:38:02.802055 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-1496e4f7-c889-4945-a6e2-30e8f5b0c49c tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed25916e1a4c05a671992fe8f0d675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51887577477404e9595e11feff3da23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:38:02.811412 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-1496e4f7-c889-4945-a6e2-30e8f5b0c49c tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] 10.222.0.66 "GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63" status: 200 len: 1259 microversion: 2.1 time: 0.180358 Jun 22 10:38:02.812116 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 540/1101] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:38:02 2022] GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63 => generated 1259 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:38:03.830651 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-04fcb046-7ca9-4ed6-afdc-6593ee8e314d tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:38:03.831859 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-04fcb046-7ca9-4ed6-afdc-6593ee8e314d tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] [instance: fb5c83d8-77a0-4ea2-b589-783e1a097f63] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:38:03.844119 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-04fcb046-7ca9-4ed6-afdc-6593ee8e314d tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:38:03.844893 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-04fcb046-7ca9-4ed6-afdc-6593ee8e314d tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:38:03.846118 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-04fcb046-7ca9-4ed6-afdc-6593ee8e314d tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:38:03.846922 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-04fcb046-7ca9-4ed6-afdc-6593ee8e314d tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:38:04.064435 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-04fcb046-7ca9-4ed6-afdc-6593ee8e314d tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed25916e1a4c05a671992fe8f0d675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51887577477404e9595e11feff3da23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:38:04.073741 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-04fcb046-7ca9-4ed6-afdc-6593ee8e314d tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] 10.222.0.66 "GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63" status: 200 len: 1259 microversion: 2.1 time: 0.247838 Jun 22 10:38:04.076314 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 562/1102] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:38:03 2022] GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63 => generated 1259 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:38:05.095000 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-d8347927-5889-479e-a882-0bea98cc003c tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:38:05.095699 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-d8347927-5889-479e-a882-0bea98cc003c tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] [instance: fb5c83d8-77a0-4ea2-b589-783e1a097f63] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:38:05.103464 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d8347927-5889-479e-a882-0bea98cc003c tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:38:05.103910 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d8347927-5889-479e-a882-0bea98cc003c tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:38:05.104721 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d8347927-5889-479e-a882-0bea98cc003c tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:38:05.105153 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-d8347927-5889-479e-a882-0bea98cc003c tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:38:05.252830 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-d8347927-5889-479e-a882-0bea98cc003c tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed25916e1a4c05a671992fe8f0d675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51887577477404e9595e11feff3da23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:38:05.261056 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-d8347927-5889-479e-a882-0bea98cc003c tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] 10.222.0.66 "GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63" status: 200 len: 1259 microversion: 2.1 time: 0.170200 Jun 22 10:38:05.261641 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 541/1103] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:38:05 2022] GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63 => generated 1259 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:38:06.235550 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [req-bf790ac7-7c8f-48ee-89ce-cc1f09dec917 req-a0c96e3b-8d06-4729-a787-810959832b66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb5c83d8-77a0-4ea2-b589-783e1a097f63", "name": "network-vif-plugged", "status": "completed", "tag": "a2eae374-e3ba-47c3-86c8-1a2f361f6348"}]} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:38:06.245987 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-bf790ac7-7c8f-48ee-89ce-cc1f09dec917 req-a0c96e3b-8d06-4729-a787-810959832b66 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:38:06.246471 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [req-bf790ac7-7c8f-48ee-89ce-cc1f09dec917 req-a0c96e3b-8d06-4729-a787-810959832b66 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:38:06.265750 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.compute.server_external_events [req-bf790ac7-7c8f-48ee-89ce-cc1f09dec917 req-a0c96e3b-8d06-4729-a787-810959832b66 service nova] Creating event network-vif-plugged:a2eae374-e3ba-47c3-86c8-1a2f361f6348 for instance fb5c83d8-77a0-4ea2-b589-783e1a097f63 on hv-cinder-84713 Jun 22 10:38:06.271756 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [req-bf790ac7-7c8f-48ee-89ce-cc1f09dec917 req-a0c96e3b-8d06-4729-a787-810959832b66 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.279728 Jun 22 10:38:06.272843 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 563/1104] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:38:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:38:06.281254 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-84f0136e-0d32-4421-b214-16626b5106ce tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:38:06.282386 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-84f0136e-0d32-4421-b214-16626b5106ce tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] [instance: fb5c83d8-77a0-4ea2-b589-783e1a097f63] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:38:06.291032 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-84f0136e-0d32-4421-b214-16626b5106ce tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:38:06.291777 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-84f0136e-0d32-4421-b214-16626b5106ce tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:38:06.292948 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-84f0136e-0d32-4421-b214-16626b5106ce tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:38:06.293610 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-84f0136e-0d32-4421-b214-16626b5106ce tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:38:06.481656 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-84f0136e-0d32-4421-b214-16626b5106ce tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed25916e1a4c05a671992fe8f0d675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51887577477404e9595e11feff3da23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:38:06.490200 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-84f0136e-0d32-4421-b214-16626b5106ce tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] 10.222.0.66 "GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63" status: 200 len: 1259 microversion: 2.1 time: 0.214640 Jun 22 10:38:06.490848 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 542/1105] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:38:06 2022] GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63 => generated 1259 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:38:07.510340 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-e0a0cc74-8b60-496b-bd0f-23292c77252f tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:38:07.511135 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-e0a0cc74-8b60-496b-bd0f-23292c77252f tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] [instance: fb5c83d8-77a0-4ea2-b589-783e1a097f63] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:38:07.518808 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e0a0cc74-8b60-496b-bd0f-23292c77252f tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:38:07.519243 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e0a0cc74-8b60-496b-bd0f-23292c77252f tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:38:07.520042 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e0a0cc74-8b60-496b-bd0f-23292c77252f tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:38:07.520473 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-e0a0cc74-8b60-496b-bd0f-23292c77252f tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:38:07.672383 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-e0a0cc74-8b60-496b-bd0f-23292c77252f tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed25916e1a4c05a671992fe8f0d675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51887577477404e9595e11feff3da23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:38:07.680992 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-e0a0cc74-8b60-496b-bd0f-23292c77252f tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] 10.222.0.66 "GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63" status: 200 len: 1259 microversion: 2.1 time: 0.175415 Jun 22 10:38:07.681582 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 564/1106] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:38:07 2022] GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63 => generated 1259 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:38:08.700089 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-da824a73-131a-4869-a8d2-a50552ee0580 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:38:08.700790 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-da824a73-131a-4869-a8d2-a50552ee0580 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] [instance: fb5c83d8-77a0-4ea2-b589-783e1a097f63] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:38:08.707937 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-da824a73-131a-4869-a8d2-a50552ee0580 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:38:08.708393 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-da824a73-131a-4869-a8d2-a50552ee0580 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:38:08.709184 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-da824a73-131a-4869-a8d2-a50552ee0580 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:38:08.709630 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-da824a73-131a-4869-a8d2-a50552ee0580 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:38:08.879510 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-da824a73-131a-4869-a8d2-a50552ee0580 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed25916e1a4c05a671992fe8f0d675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51887577477404e9595e11feff3da23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:38:08.888471 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-da824a73-131a-4869-a8d2-a50552ee0580 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] 10.222.0.66 "GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63" status: 200 len: 1443 microversion: 2.1 time: 0.192782 Jun 22 10:38:08.889076 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 543/1107] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:38:08 2022] GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63 => generated 1443 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:38:08.913255 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-26a62636-a933-40c9-a5c3-88b9e3023476 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:38:08.913960 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-26a62636-a933-40c9-a5c3-88b9e3023476 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] [instance: fb5c83d8-77a0-4ea2-b589-783e1a097f63] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:38:08.921167 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-26a62636-a933-40c9-a5c3-88b9e3023476 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:38:08.921624 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-26a62636-a933-40c9-a5c3-88b9e3023476 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:38:08.922428 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-26a62636-a933-40c9-a5c3-88b9e3023476 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:38:08.922912 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-26a62636-a933-40c9-a5c3-88b9e3023476 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:38:09.074612 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-26a62636-a933-40c9-a5c3-88b9e3023476 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed25916e1a4c05a671992fe8f0d675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51887577477404e9595e11feff3da23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:38:09.083807 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-26a62636-a933-40c9-a5c3-88b9e3023476 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] 10.222.0.66 "GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63" status: 200 len: 1443 microversion: 2.1 time: 0.179973 Jun 22 10:38:09.084485 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 565/1108] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:38:08 2022] GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63 => generated 1443 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:38:11.557894 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-38181c08-0e88-4771-8734-0dcfcae4a192 req-1f6105a5-9112-4b3d-a70b-e06aeff6d995 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb5c83d8-77a0-4ea2-b589-783e1a097f63", "tag": "a2eae374-e3ba-47c3-86c8-1a2f361f6348"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:38:11.568975 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-38181c08-0e88-4771-8734-0dcfcae4a192 req-1f6105a5-9112-4b3d-a70b-e06aeff6d995 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:38:11.569639 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-38181c08-0e88-4771-8734-0dcfcae4a192 req-1f6105a5-9112-4b3d-a70b-e06aeff6d995 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:38:11.588287 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-38181c08-0e88-4771-8734-0dcfcae4a192 req-1f6105a5-9112-4b3d-a70b-e06aeff6d995 service nova] Creating event network-changed:a2eae374-e3ba-47c3-86c8-1a2f361f6348 for instance fb5c83d8-77a0-4ea2-b589-783e1a097f63 on hv-cinder-84713 Jun 22 10:38:11.596382 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-38181c08-0e88-4771-8734-0dcfcae4a192 req-1f6105a5-9112-4b3d-a70b-e06aeff6d995 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136799 Jun 22 10:38:11.597372 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 544/1109] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:38:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:39:05.851760 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 10:39:05.852574 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Wed Jun 22 10:39:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 10:40:25.353341 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1578edbd-35fb-4c35-a141-5760e3e917de] AMQP server on 10.222.0.66:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 22 10:40:25.354344 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:40:25.355255 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:SELECT=48 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:40:25.360746 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-5eb0f475-a509-475f-80ca-e40780bc2072 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:40:25.361280 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-5eb0f475-a509-475f-80ca-e40780bc2072 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] [instance: fb5c83d8-77a0-4ea2-b589-783e1a097f63] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:40:25.369758 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5eb0f475-a509-475f-80ca-e40780bc2072 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:40:25.370244 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5eb0f475-a509-475f-80ca-e40780bc2072 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:40:25.371080 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5eb0f475-a509-475f-80ca-e40780bc2072 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:40:25.371570 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-5eb0f475-a509-475f-80ca-e40780bc2072 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:40:25.399629 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.objects.instance [None req-5eb0f475-a509-475f-80ca-e40780bc2072 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lazy-loading 'flavor' on Instance uuid fb5c83d8-77a0-4ea2-b589-783e1a097f63 {{(pid=117680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:40:25.491279 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-5eb0f475-a509-475f-80ca-e40780bc2072 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] 10.222.0.66 "POST /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63/action" status: 202 len: 0 microversion: 2.1 time: 0.139613 Jun 22 10:40:25.492156 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 566/1110] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Jun 22 10:40:25 2022] POST /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:40:25.499486 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8d36c591-33df-43ad-bda6-f230bdf3554e] AMQP server on 10.222.0.66:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 22 10:40:25.500618 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_api:SELECT=22 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:40:25.501907 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_cell1:SELECT=50 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:40:25.510386 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-de70745b-59cd-4929-a6af-1490ecd03d17 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:40:25.511707 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-de70745b-59cd-4929-a6af-1490ecd03d17 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] [instance: fb5c83d8-77a0-4ea2-b589-783e1a097f63] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:40:25.524923 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-de70745b-59cd-4929-a6af-1490ecd03d17 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:40:25.525509 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-de70745b-59cd-4929-a6af-1490ecd03d17 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:40:25.526629 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-de70745b-59cd-4929-a6af-1490ecd03d17 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:40:25.527416 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-de70745b-59cd-4929-a6af-1490ecd03d17 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:40:25.709410 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-de70745b-59cd-4929-a6af-1490ecd03d17 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed25916e1a4c05a671992fe8f0d675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51887577477404e9595e11feff3da23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:40:25.718167 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-de70745b-59cd-4929-a6af-1490ecd03d17 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] 10.222.0.66 "GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63" status: 200 len: 1567 microversion: 2.1 time: 0.220996 Jun 22 10:40:25.718905 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 545/1111] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:40:25 2022] GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63 => generated 1567 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:40:26.739596 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-4714f7f3-aac2-473e-b569-651315931111 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:40:26.740398 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-4714f7f3-aac2-473e-b569-651315931111 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] [instance: fb5c83d8-77a0-4ea2-b589-783e1a097f63] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:40:26.750387 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4714f7f3-aac2-473e-b569-651315931111 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:40:26.750948 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4714f7f3-aac2-473e-b569-651315931111 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:40:26.751899 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4714f7f3-aac2-473e-b569-651315931111 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:40:26.752394 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4714f7f3-aac2-473e-b569-651315931111 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:40:26.759257 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO oslo.messaging._drivers.impl_rabbit [-] [1578edbd-35fb-4c35-a141-5760e3e917de] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 44594. Jun 22 10:40:26.917481 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-4714f7f3-aac2-473e-b569-651315931111 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed25916e1a4c05a671992fe8f0d675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51887577477404e9595e11feff3da23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:40:26.925970 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-4714f7f3-aac2-473e-b569-651315931111 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] 10.222.0.66 "GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63" status: 200 len: 1567 microversion: 2.1 time: 0.193021 Jun 22 10:40:26.926795 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 567/1112] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:40:26 2022] GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63 => generated 1567 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:40:27.950409 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-fdd795ab-0767-4031-8480-bf951265d62f tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:40:27.951282 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-fdd795ab-0767-4031-8480-bf951265d62f tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] [instance: fb5c83d8-77a0-4ea2-b589-783e1a097f63] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:40:27.965096 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO oslo.messaging._drivers.impl_rabbit [-] [8d36c591-33df-43ad-bda6-f230bdf3554e] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 44598. Jun 22 10:40:27.968493 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-fdd795ab-0767-4031-8480-bf951265d62f tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:40:27.968986 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-fdd795ab-0767-4031-8480-bf951265d62f tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:40:27.969858 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-fdd795ab-0767-4031-8480-bf951265d62f tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:40:27.970337 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-fdd795ab-0767-4031-8480-bf951265d62f tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:40:28.129964 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-fdd795ab-0767-4031-8480-bf951265d62f tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed25916e1a4c05a671992fe8f0d675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51887577477404e9595e11feff3da23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:40:28.139071 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-fdd795ab-0767-4031-8480-bf951265d62f tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] 10.222.0.66 "GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63" status: 200 len: 1567 microversion: 2.1 time: 0.192392 Jun 22 10:40:28.139755 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 546/1113] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:40:27 2022] GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63 => generated 1567 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:40:29.165569 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-4ff321ac-406c-4378-9a19-b756eba64f87 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:40:29.166599 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-4ff321ac-406c-4378-9a19-b756eba64f87 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] [instance: fb5c83d8-77a0-4ea2-b589-783e1a097f63] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:40:29.174555 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4ff321ac-406c-4378-9a19-b756eba64f87 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:40:29.175095 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4ff321ac-406c-4378-9a19-b756eba64f87 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:40:29.175972 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4ff321ac-406c-4378-9a19-b756eba64f87 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:40:29.176491 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-4ff321ac-406c-4378-9a19-b756eba64f87 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:40:29.327443 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-4ff321ac-406c-4378-9a19-b756eba64f87 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed25916e1a4c05a671992fe8f0d675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51887577477404e9595e11feff3da23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:40:29.336404 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-4ff321ac-406c-4378-9a19-b756eba64f87 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] 10.222.0.66 "GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63" status: 200 len: 1567 microversion: 2.1 time: 0.175057 Jun 22 10:40:29.337055 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 568/1114] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:40:29 2022] GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63 => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:40:30.354543 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-0dc00f78-79e2-4fbd-8b06-ae6cb2408dc1 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:40:30.355222 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-0dc00f78-79e2-4fbd-8b06-ae6cb2408dc1 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] [instance: fb5c83d8-77a0-4ea2-b589-783e1a097f63] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:40:30.362439 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0dc00f78-79e2-4fbd-8b06-ae6cb2408dc1 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:40:30.362920 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0dc00f78-79e2-4fbd-8b06-ae6cb2408dc1 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:40:30.363842 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0dc00f78-79e2-4fbd-8b06-ae6cb2408dc1 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:40:30.364273 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0dc00f78-79e2-4fbd-8b06-ae6cb2408dc1 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:40:30.517103 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-0dc00f78-79e2-4fbd-8b06-ae6cb2408dc1 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed25916e1a4c05a671992fe8f0d675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51887577477404e9595e11feff3da23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:40:30.527042 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-0dc00f78-79e2-4fbd-8b06-ae6cb2408dc1 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] 10.222.0.66 "GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63" status: 200 len: 1567 microversion: 2.1 time: 0.176436 Jun 22 10:40:30.527712 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 547/1115] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:40:30 2022] GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63 => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:40:31.550227 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-a87de90a-fc0b-42dc-be05-cf76f7b297a3 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:40:31.551463 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-a87de90a-fc0b-42dc-be05-cf76f7b297a3 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] [instance: fb5c83d8-77a0-4ea2-b589-783e1a097f63] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:40:31.564254 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a87de90a-fc0b-42dc-be05-cf76f7b297a3 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:40:31.565074 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a87de90a-fc0b-42dc-be05-cf76f7b297a3 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:40:31.566769 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a87de90a-fc0b-42dc-be05-cf76f7b297a3 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:40:31.567612 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-a87de90a-fc0b-42dc-be05-cf76f7b297a3 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:40:31.733479 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-a87de90a-fc0b-42dc-be05-cf76f7b297a3 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed25916e1a4c05a671992fe8f0d675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51887577477404e9595e11feff3da23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:40:31.742409 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-a87de90a-fc0b-42dc-be05-cf76f7b297a3 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] 10.222.0.66 "GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63" status: 200 len: 1567 microversion: 2.1 time: 0.200252 Jun 22 10:40:31.743165 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 569/1116] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:40:31 2022] GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63 => generated 1567 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:40:32.760336 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-8fb4956d-62c1-44a9-b611-eac84531d467 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:40:32.761066 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-8fb4956d-62c1-44a9-b611-eac84531d467 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] [instance: fb5c83d8-77a0-4ea2-b589-783e1a097f63] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:40:32.768167 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8fb4956d-62c1-44a9-b611-eac84531d467 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:40:32.768620 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8fb4956d-62c1-44a9-b611-eac84531d467 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:40:32.769408 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8fb4956d-62c1-44a9-b611-eac84531d467 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:40:32.769949 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-8fb4956d-62c1-44a9-b611-eac84531d467 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:40:32.924027 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-8fb4956d-62c1-44a9-b611-eac84531d467 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed25916e1a4c05a671992fe8f0d675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51887577477404e9595e11feff3da23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:40:32.932955 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-8fb4956d-62c1-44a9-b611-eac84531d467 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] 10.222.0.66 "GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63" status: 200 len: 1567 microversion: 2.1 time: 0.176729 Jun 22 10:40:32.933664 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 548/1117] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:40:32 2022] GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63 => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:40:33.952095 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-ff3752d4-5a63-4221-ad66-e0ce8335a48b tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:40:33.952855 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-ff3752d4-5a63-4221-ad66-e0ce8335a48b tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] [instance: fb5c83d8-77a0-4ea2-b589-783e1a097f63] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:40:33.960371 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ff3752d4-5a63-4221-ad66-e0ce8335a48b tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:40:33.960800 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ff3752d4-5a63-4221-ad66-e0ce8335a48b tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:40:33.961638 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ff3752d4-5a63-4221-ad66-e0ce8335a48b tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:40:33.962076 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-ff3752d4-5a63-4221-ad66-e0ce8335a48b tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:40:34.205200 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-ff3752d4-5a63-4221-ad66-e0ce8335a48b tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed25916e1a4c05a671992fe8f0d675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51887577477404e9595e11feff3da23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:40:34.214144 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-ff3752d4-5a63-4221-ad66-e0ce8335a48b tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] 10.222.0.66 "GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63" status: 200 len: 1567 microversion: 2.1 time: 0.266283 Jun 22 10:40:34.214831 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 570/1118] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:40:33 2022] GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63 => generated 1567 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:40:35.233024 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-1f5e6091-34c7-45f7-add8-25327506991b tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:40:35.233760 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-1f5e6091-34c7-45f7-add8-25327506991b tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] [instance: fb5c83d8-77a0-4ea2-b589-783e1a097f63] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:40:35.241967 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1f5e6091-34c7-45f7-add8-25327506991b tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:40:35.242515 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1f5e6091-34c7-45f7-add8-25327506991b tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:40:35.243580 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1f5e6091-34c7-45f7-add8-25327506991b tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:40:35.244195 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-1f5e6091-34c7-45f7-add8-25327506991b tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:40:35.509048 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-1f5e6091-34c7-45f7-add8-25327506991b tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed25916e1a4c05a671992fe8f0d675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51887577477404e9595e11feff3da23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:40:35.522716 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-1f5e6091-34c7-45f7-add8-25327506991b tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] 10.222.0.66 "GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63" status: 200 len: 1567 microversion: 2.1 time: 0.293124 Jun 22 10:40:35.526825 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 549/1119] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:40:35 2022] GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63 => generated 1567 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:40:36.545117 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-8e63ab80-1a54-4401-a0d6-da3f2ea9e0d6 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:40:36.545803 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-8e63ab80-1a54-4401-a0d6-da3f2ea9e0d6 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] [instance: fb5c83d8-77a0-4ea2-b589-783e1a097f63] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:40:36.553741 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8e63ab80-1a54-4401-a0d6-da3f2ea9e0d6 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:40:36.554202 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8e63ab80-1a54-4401-a0d6-da3f2ea9e0d6 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:40:36.555056 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8e63ab80-1a54-4401-a0d6-da3f2ea9e0d6 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:40:36.555515 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8e63ab80-1a54-4401-a0d6-da3f2ea9e0d6 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:40:36.710839 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-8e63ab80-1a54-4401-a0d6-da3f2ea9e0d6 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed25916e1a4c05a671992fe8f0d675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51887577477404e9595e11feff3da23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:40:36.719595 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-8e63ab80-1a54-4401-a0d6-da3f2ea9e0d6 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] 10.222.0.66 "GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63" status: 200 len: 1567 microversion: 2.1 time: 0.178734 Jun 22 10:40:36.720206 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 571/1120] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:40:36 2022] GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63 => generated 1567 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:40:37.740723 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-15a0845b-747e-45a7-b09d-756f55ec8c9a tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:40:37.741640 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-15a0845b-747e-45a7-b09d-756f55ec8c9a tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] [instance: fb5c83d8-77a0-4ea2-b589-783e1a097f63] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:40:37.752719 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-15a0845b-747e-45a7-b09d-756f55ec8c9a tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:40:37.753533 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-15a0845b-747e-45a7-b09d-756f55ec8c9a tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:40:37.754883 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-15a0845b-747e-45a7-b09d-756f55ec8c9a tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:40:37.755664 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-15a0845b-747e-45a7-b09d-756f55ec8c9a tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:40:37.918688 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-15a0845b-747e-45a7-b09d-756f55ec8c9a tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed25916e1a4c05a671992fe8f0d675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51887577477404e9595e11feff3da23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:40:37.931047 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-15a0845b-747e-45a7-b09d-756f55ec8c9a tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] 10.222.0.66 "GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63" status: 200 len: 1567 microversion: 2.1 time: 0.196908 Jun 22 10:40:37.931853 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 550/1121] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:40:37 2022] GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63 => generated 1567 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:40:38.949971 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-b8f1b6f1-7b03-4aab-96c9-c11fae297f91 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:40:38.950606 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-b8f1b6f1-7b03-4aab-96c9-c11fae297f91 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] [instance: fb5c83d8-77a0-4ea2-b589-783e1a097f63] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:40:38.958006 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b8f1b6f1-7b03-4aab-96c9-c11fae297f91 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:40:38.958428 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b8f1b6f1-7b03-4aab-96c9-c11fae297f91 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:40:38.959289 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b8f1b6f1-7b03-4aab-96c9-c11fae297f91 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:40:38.959727 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-b8f1b6f1-7b03-4aab-96c9-c11fae297f91 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:40:39.119958 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-b8f1b6f1-7b03-4aab-96c9-c11fae297f91 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed25916e1a4c05a671992fe8f0d675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51887577477404e9595e11feff3da23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:40:39.128800 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-b8f1b6f1-7b03-4aab-96c9-c11fae297f91 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] 10.222.0.66 "GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63" status: 200 len: 1567 microversion: 2.1 time: 0.183317 Jun 22 10:40:39.129567 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 572/1122] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:40:38 2022] GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63 => generated 1567 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:40:40.146877 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-9759d443-b595-4ad9-95aa-d724c3a792ad tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:40:40.147595 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-9759d443-b595-4ad9-95aa-d724c3a792ad tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] [instance: fb5c83d8-77a0-4ea2-b589-783e1a097f63] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:40:40.155506 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9759d443-b595-4ad9-95aa-d724c3a792ad tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:40:40.156051 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9759d443-b595-4ad9-95aa-d724c3a792ad tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:40:40.156927 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9759d443-b595-4ad9-95aa-d724c3a792ad tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:40:40.157432 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-9759d443-b595-4ad9-95aa-d724c3a792ad tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:40:40.318407 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-9759d443-b595-4ad9-95aa-d724c3a792ad tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed25916e1a4c05a671992fe8f0d675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51887577477404e9595e11feff3da23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:40:40.327429 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-9759d443-b595-4ad9-95aa-d724c3a792ad tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] 10.222.0.66 "GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63" status: 200 len: 1567 microversion: 2.1 time: 0.184785 Jun 22 10:40:40.328036 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 551/1123] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:40:40 2022] GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63 => generated 1567 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:40:41.345504 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-86560095-78fa-4380-b71c-dac0d4b20828 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:40:41.346164 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-86560095-78fa-4380-b71c-dac0d4b20828 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] [instance: fb5c83d8-77a0-4ea2-b589-783e1a097f63] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:40:41.353338 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-86560095-78fa-4380-b71c-dac0d4b20828 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:40:41.353784 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-86560095-78fa-4380-b71c-dac0d4b20828 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:40:41.354571 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-86560095-78fa-4380-b71c-dac0d4b20828 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:40:41.355034 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-86560095-78fa-4380-b71c-dac0d4b20828 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:40:41.527276 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-86560095-78fa-4380-b71c-dac0d4b20828 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed25916e1a4c05a671992fe8f0d675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51887577477404e9595e11feff3da23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:40:41.536295 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-86560095-78fa-4380-b71c-dac0d4b20828 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] 10.222.0.66 "GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63" status: 200 len: 1567 microversion: 2.1 time: 0.194892 Jun 22 10:40:41.536897 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 573/1124] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:40:41 2022] GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63 => generated 1567 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:40:42.554399 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-4baba448-4a6c-4d02-ae8f-9fe7d8e4e263 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:40:42.555134 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-4baba448-4a6c-4d02-ae8f-9fe7d8e4e263 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] [instance: fb5c83d8-77a0-4ea2-b589-783e1a097f63] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:40:42.563405 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4baba448-4a6c-4d02-ae8f-9fe7d8e4e263 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:40:42.563947 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4baba448-4a6c-4d02-ae8f-9fe7d8e4e263 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:40:42.564882 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4baba448-4a6c-4d02-ae8f-9fe7d8e4e263 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:40:42.565445 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-4baba448-4a6c-4d02-ae8f-9fe7d8e4e263 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:40:42.726298 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-4baba448-4a6c-4d02-ae8f-9fe7d8e4e263 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed25916e1a4c05a671992fe8f0d675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51887577477404e9595e11feff3da23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:40:42.736667 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-4baba448-4a6c-4d02-ae8f-9fe7d8e4e263 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] 10.222.0.66 "GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63" status: 200 len: 1567 microversion: 2.1 time: 0.186528 Jun 22 10:40:42.737333 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 552/1125] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:40:42 2022] GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63 => generated 1567 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:40:43.757720 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-2732460e-b22c-447d-8cfc-6334f5d57b76 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:40:43.758651 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-2732460e-b22c-447d-8cfc-6334f5d57b76 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] [instance: fb5c83d8-77a0-4ea2-b589-783e1a097f63] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:40:43.766113 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2732460e-b22c-447d-8cfc-6334f5d57b76 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:40:43.766600 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2732460e-b22c-447d-8cfc-6334f5d57b76 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:40:43.767406 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2732460e-b22c-447d-8cfc-6334f5d57b76 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:40:43.767851 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-2732460e-b22c-447d-8cfc-6334f5d57b76 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:40:43.934833 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-2732460e-b22c-447d-8cfc-6334f5d57b76 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed25916e1a4c05a671992fe8f0d675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51887577477404e9595e11feff3da23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:40:43.947697 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-2732460e-b22c-447d-8cfc-6334f5d57b76 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] 10.222.0.66 "GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63" status: 200 len: 1508 microversion: 2.1 time: 0.193814 Jun 22 10:40:43.948575 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 574/1126] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:40:43 2022] GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63 => generated 1508 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:40:43.973937 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-77674951-26b9-4c3d-a77c-f0164f174fe3 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:40:43.974950 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-77674951-26b9-4c3d-a77c-f0164f174fe3 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] [instance: fb5c83d8-77a0-4ea2-b589-783e1a097f63] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:40:43.985894 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-77674951-26b9-4c3d-a77c-f0164f174fe3 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:40:43.986411 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-77674951-26b9-4c3d-a77c-f0164f174fe3 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:40:43.987406 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-77674951-26b9-4c3d-a77c-f0164f174fe3 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:40:43.987955 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-77674951-26b9-4c3d-a77c-f0164f174fe3 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:40:44.161667 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-77674951-26b9-4c3d-a77c-f0164f174fe3 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] 10.222.0.66 "POST /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63/action" status: 202 len: 0 microversion: 2.1 time: 0.193391 Jun 22 10:40:44.162783 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 553/1127] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Jun 22 10:40:43 2022] POST /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:40:44.171831 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-d54d97b9-ea12-4c29-9b02-11290f3a605e tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:40:44.172846 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-d54d97b9-ea12-4c29-9b02-11290f3a605e tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] [instance: fb5c83d8-77a0-4ea2-b589-783e1a097f63] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:40:44.181698 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d54d97b9-ea12-4c29-9b02-11290f3a605e tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:40:44.182354 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d54d97b9-ea12-4c29-9b02-11290f3a605e tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:40:44.183696 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d54d97b9-ea12-4c29-9b02-11290f3a605e tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:40:44.184585 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-d54d97b9-ea12-4c29-9b02-11290f3a605e tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:40:44.371258 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-d54d97b9-ea12-4c29-9b02-11290f3a605e tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed25916e1a4c05a671992fe8f0d675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51887577477404e9595e11feff3da23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:40:44.381566 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-d54d97b9-ea12-4c29-9b02-11290f3a605e tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] 10.222.0.66 "GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63" status: 200 len: 1516 microversion: 2.1 time: 0.212534 Jun 22 10:40:44.382230 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 575/1128] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:40:44 2022] GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63 => generated 1516 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:40:45.405008 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-2b9ffce2-11a5-472e-b93b-e8ba9be9a02e tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:40:45.406325 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-2b9ffce2-11a5-472e-b93b-e8ba9be9a02e tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] [instance: fb5c83d8-77a0-4ea2-b589-783e1a097f63] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:40:45.418048 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2b9ffce2-11a5-472e-b93b-e8ba9be9a02e tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:40:45.418901 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2b9ffce2-11a5-472e-b93b-e8ba9be9a02e tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:40:45.420288 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2b9ffce2-11a5-472e-b93b-e8ba9be9a02e tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:40:45.421061 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-2b9ffce2-11a5-472e-b93b-e8ba9be9a02e tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:40:45.651222 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-2b9ffce2-11a5-472e-b93b-e8ba9be9a02e tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed25916e1a4c05a671992fe8f0d675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51887577477404e9595e11feff3da23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:40:45.660040 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-2b9ffce2-11a5-472e-b93b-e8ba9be9a02e tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] 10.222.0.66 "GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63" status: 200 len: 1518 microversion: 2.1 time: 0.263813 Jun 22 10:40:45.660634 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 554/1129] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:40:45 2022] GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63 => generated 1518 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:40:46.679083 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-be3abad0-650f-49b2-851a-a9bbaca79bf5 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:40:46.679736 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-be3abad0-650f-49b2-851a-a9bbaca79bf5 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] [instance: fb5c83d8-77a0-4ea2-b589-783e1a097f63] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:40:46.688018 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-be3abad0-650f-49b2-851a-a9bbaca79bf5 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:40:46.688762 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-be3abad0-650f-49b2-851a-a9bbaca79bf5 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:40:46.690112 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-be3abad0-650f-49b2-851a-a9bbaca79bf5 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:40:46.690601 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-be3abad0-650f-49b2-851a-a9bbaca79bf5 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:40:46.822233 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-dd497934-0daa-4ac4-9edc-9979f9dd728e req-f5cf3791-287e-407e-beae-50319b93e9c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb5c83d8-77a0-4ea2-b589-783e1a097f63", "name": "network-vif-unplugged", "status": "completed", "tag": "a2eae374-e3ba-47c3-86c8-1a2f361f6348"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:40:46.832442 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-dd497934-0daa-4ac4-9edc-9979f9dd728e req-f5cf3791-287e-407e-beae-50319b93e9c5 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:40:46.832914 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-dd497934-0daa-4ac4-9edc-9979f9dd728e req-f5cf3791-287e-407e-beae-50319b93e9c5 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:40:46.849290 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-dd497934-0daa-4ac4-9edc-9979f9dd728e req-f5cf3791-287e-407e-beae-50319b93e9c5 service nova] Creating event network-vif-unplugged:a2eae374-e3ba-47c3-86c8-1a2f361f6348 for instance fb5c83d8-77a0-4ea2-b589-783e1a097f63 on hv-cinder-84713 Jun 22 10:40:46.853416 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR oslo.messaging._drivers.impl_rabbit [req-dd497934-0daa-4ac4-9edc-9979f9dd728e req-f5cf3791-287e-407e-beae-50319b93e9c5 service nova] [29c30fd2-ac70-453b-b008-5dab2ef7cf6d] AMQP server on 10.222.0.66:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 22 10:40:46.886329 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-be3abad0-650f-49b2-851a-a9bbaca79bf5 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed25916e1a4c05a671992fe8f0d675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51887577477404e9595e11feff3da23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:40:46.895070 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-be3abad0-650f-49b2-851a-a9bbaca79bf5 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] 10.222.0.66 "GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63" status: 200 len: 1574 microversion: 2.1 time: 0.220235 Jun 22 10:40:46.895699 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 576/1130] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:40:46 2022] GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63 => generated 1574 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:40:47.862531 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO oslo.messaging._drivers.impl_rabbit [req-dd497934-0daa-4ac4-9edc-9979f9dd728e req-f5cf3791-287e-407e-beae-50319b93e9c5 service nova] [29c30fd2-ac70-453b-b008-5dab2ef7cf6d] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 44660. Jun 22 10:40:47.867412 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-dd497934-0daa-4ac4-9edc-9979f9dd728e req-f5cf3791-287e-407e-beae-50319b93e9c5 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 1.049163 Jun 22 10:40:47.868433 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 555/1131] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:40:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:40:47.914015 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-7ba30801-b8a7-4aa1-8545-a9eefb528051 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:40:47.914807 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-7ba30801-b8a7-4aa1-8545-a9eefb528051 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] [instance: fb5c83d8-77a0-4ea2-b589-783e1a097f63] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:40:47.921976 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7ba30801-b8a7-4aa1-8545-a9eefb528051 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:40:47.922427 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7ba30801-b8a7-4aa1-8545-a9eefb528051 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:40:47.923252 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7ba30801-b8a7-4aa1-8545-a9eefb528051 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:40:47.923688 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-7ba30801-b8a7-4aa1-8545-a9eefb528051 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:40:48.061682 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-7ba30801-b8a7-4aa1-8545-a9eefb528051 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed25916e1a4c05a671992fe8f0d675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51887577477404e9595e11feff3da23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:40:48.069717 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-7ba30801-b8a7-4aa1-8545-a9eefb528051 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] 10.222.0.66 "GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63" status: 200 len: 1574 microversion: 2.1 time: 0.159937 Jun 22 10:40:48.070280 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 577/1132] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:40:47 2022] GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63 => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:40:49.088890 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-0e4e64cc-2150-4c45-a948-066a0bbdb716 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:40:49.089553 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-0e4e64cc-2150-4c45-a948-066a0bbdb716 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] [instance: fb5c83d8-77a0-4ea2-b589-783e1a097f63] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:40:49.097137 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0e4e64cc-2150-4c45-a948-066a0bbdb716 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:40:49.097591 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0e4e64cc-2150-4c45-a948-066a0bbdb716 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:40:49.098416 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0e4e64cc-2150-4c45-a948-066a0bbdb716 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:40:49.099013 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-0e4e64cc-2150-4c45-a948-066a0bbdb716 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:40:49.250208 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-0e4e64cc-2150-4c45-a948-066a0bbdb716 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed25916e1a4c05a671992fe8f0d675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51887577477404e9595e11feff3da23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:40:49.258239 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-0e4e64cc-2150-4c45-a948-066a0bbdb716 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] 10.222.0.66 "GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63" status: 200 len: 1574 microversion: 2.1 time: 0.174305 Jun 22 10:40:49.258809 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 556/1133] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:40:49 2022] GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63 => generated 1574 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:40:50.276144 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-f7dcf2b2-175c-487b-863b-9f8ada3cc207 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:40:50.276847 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-f7dcf2b2-175c-487b-863b-9f8ada3cc207 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] [instance: fb5c83d8-77a0-4ea2-b589-783e1a097f63] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:40:50.286099 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f7dcf2b2-175c-487b-863b-9f8ada3cc207 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:40:50.287069 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f7dcf2b2-175c-487b-863b-9f8ada3cc207 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:40:50.288121 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f7dcf2b2-175c-487b-863b-9f8ada3cc207 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:40:50.288670 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-f7dcf2b2-175c-487b-863b-9f8ada3cc207 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:40:50.452475 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-f7dcf2b2-175c-487b-863b-9f8ada3cc207 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed25916e1a4c05a671992fe8f0d675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51887577477404e9595e11feff3da23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:40:50.461854 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-f7dcf2b2-175c-487b-863b-9f8ada3cc207 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] 10.222.0.66 "GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63" status: 200 len: 1574 microversion: 2.1 time: 0.189839 Jun 22 10:40:50.462613 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 578/1134] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:40:50 2022] GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63 => generated 1574 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:40:51.480814 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-66b2c4b8-a8e6-4bd1-b4ba-a775e8b11425 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:40:51.481469 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-66b2c4b8-a8e6-4bd1-b4ba-a775e8b11425 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] [instance: fb5c83d8-77a0-4ea2-b589-783e1a097f63] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:40:51.489394 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-66b2c4b8-a8e6-4bd1-b4ba-a775e8b11425 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:40:51.489839 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-66b2c4b8-a8e6-4bd1-b4ba-a775e8b11425 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:40:51.490673 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-66b2c4b8-a8e6-4bd1-b4ba-a775e8b11425 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:40:51.491106 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-66b2c4b8-a8e6-4bd1-b4ba-a775e8b11425 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:40:51.641099 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-66b2c4b8-a8e6-4bd1-b4ba-a775e8b11425 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed25916e1a4c05a671992fe8f0d675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51887577477404e9595e11feff3da23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:40:51.650394 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-66b2c4b8-a8e6-4bd1-b4ba-a775e8b11425 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] 10.222.0.66 "GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63" status: 200 len: 1574 microversion: 2.1 time: 0.173604 Jun 22 10:40:51.651241 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 557/1135] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:40:51 2022] GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63 => generated 1574 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:40:52.672728 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-22642f72-6307-45f4-b1be-2eb6e3875c74 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:40:52.674367 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-22642f72-6307-45f4-b1be-2eb6e3875c74 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] [instance: fb5c83d8-77a0-4ea2-b589-783e1a097f63] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:40:52.682671 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-22642f72-6307-45f4-b1be-2eb6e3875c74 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:40:52.683095 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-22642f72-6307-45f4-b1be-2eb6e3875c74 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:40:52.683920 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-22642f72-6307-45f4-b1be-2eb6e3875c74 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:40:52.684357 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-22642f72-6307-45f4-b1be-2eb6e3875c74 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:40:53.158482 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-22642f72-6307-45f4-b1be-2eb6e3875c74 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed25916e1a4c05a671992fe8f0d675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51887577477404e9595e11feff3da23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:40:53.168752 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-22642f72-6307-45f4-b1be-2eb6e3875c74 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] 10.222.0.66 "GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63" status: 200 len: 1574 microversion: 2.1 time: 0.503112 Jun 22 10:40:53.169375 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 579/1136] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:40:52 2022] GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63 => generated 1574 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:40:54.196291 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-eff06594-a2e3-4d7b-be38-374621f165f8 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:40:54.197346 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-eff06594-a2e3-4d7b-be38-374621f165f8 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] [instance: fb5c83d8-77a0-4ea2-b589-783e1a097f63] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:40:54.211767 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-eff06594-a2e3-4d7b-be38-374621f165f8 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:40:54.212510 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-eff06594-a2e3-4d7b-be38-374621f165f8 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:40:54.213846 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-eff06594-a2e3-4d7b-be38-374621f165f8 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:40:54.214660 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-eff06594-a2e3-4d7b-be38-374621f165f8 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:40:54.371304 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-eff06594-a2e3-4d7b-be38-374621f165f8 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed25916e1a4c05a671992fe8f0d675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51887577477404e9595e11feff3da23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:40:54.383892 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-eff06594-a2e3-4d7b-be38-374621f165f8 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] 10.222.0.66 "GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63" status: 200 len: 1574 microversion: 2.1 time: 0.194889 Jun 22 10:40:54.384563 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 558/1137] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:40:54 2022] GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63 => generated 1574 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:40:55.404821 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-02e06b1f-393e-4a8e-9386-18c5062600b8 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:40:55.406760 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-02e06b1f-393e-4a8e-9386-18c5062600b8 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] [instance: fb5c83d8-77a0-4ea2-b589-783e1a097f63] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:40:55.409778 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_api:SELECT=29 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:40:55.418152 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-02e06b1f-393e-4a8e-9386-18c5062600b8 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:40:55.419254 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-02e06b1f-393e-4a8e-9386-18c5062600b8 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:40:55.420815 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-02e06b1f-393e-4a8e-9386-18c5062600b8 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:40:55.421862 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-02e06b1f-393e-4a8e-9386-18c5062600b8 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:40:55.428264 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:40:55.723094 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-02e06b1f-393e-4a8e-9386-18c5062600b8 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed25916e1a4c05a671992fe8f0d675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51887577477404e9595e11feff3da23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:40:55.732372 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-02e06b1f-393e-4a8e-9386-18c5062600b8 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] 10.222.0.66 "GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63" status: 200 len: 1561 microversion: 2.1 time: 0.333620 Jun 22 10:40:55.733230 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 580/1138] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:40:55 2022] GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63 => generated 1561 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:40:57.033519 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-e1e8fc7f-da1e-48e0-b3c4-66d34c6d70dc req-99565444-1150-4458-a754-1afacd8a59c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb5c83d8-77a0-4ea2-b589-783e1a097f63", "name": "network-vif-plugged", "status": "completed", "tag": "a2eae374-e3ba-47c3-86c8-1a2f361f6348"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:40:57.038226 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_api:SELECT=31 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:40:57.044801 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-e1e8fc7f-da1e-48e0-b3c4-66d34c6d70dc req-99565444-1150-4458-a754-1afacd8a59c8 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:40:57.045300 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-e1e8fc7f-da1e-48e0-b3c4-66d34c6d70dc req-99565444-1150-4458-a754-1afacd8a59c8 service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:40:57.050442 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:40:57.060573 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-e1e8fc7f-da1e-48e0-b3c4-66d34c6d70dc req-99565444-1150-4458-a754-1afacd8a59c8 service nova] Creating event network-vif-plugged:a2eae374-e3ba-47c3-86c8-1a2f361f6348 for instance fb5c83d8-77a0-4ea2-b589-783e1a097f63 on hv-cinder-84713 Jun 22 10:40:57.066599 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-e1e8fc7f-da1e-48e0-b3c4-66d34c6d70dc req-99565444-1150-4458-a754-1afacd8a59c8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036902 Jun 22 10:40:57.067585 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 559/1139] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:40:59.113636 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 10:40:59.114356 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Wed Jun 22 10:40:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 10:42:25.412744 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG dbcounter [-] [117679] Writing DB stats nova_api:SELECT=1 {{(pid=117679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:42:25.417347 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_api:SELECT=1 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:42:25.419265 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG dbcounter [-] [117680] Writing DB stats nova_cell1:SELECT=5 {{(pid=117680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 22 10:42:25.422680 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-a2ad0616-9328-4116-87e5-e1fe686dfd12 req-b7d7dcf8-beba-472b-8c64-79e77c6f45ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb5c83d8-77a0-4ea2-b589-783e1a097f63", "tag": "a2eae374-e3ba-47c3-86c8-1a2f361f6348"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:42:25.438364 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-a2ad0616-9328-4116-87e5-e1fe686dfd12 req-b7d7dcf8-beba-472b-8c64-79e77c6f45ed service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:42:25.439350 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-a2ad0616-9328-4116-87e5-e1fe686dfd12 req-b7d7dcf8-beba-472b-8c64-79e77c6f45ed service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:42:25.456786 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-a2ad0616-9328-4116-87e5-e1fe686dfd12 req-b7d7dcf8-beba-472b-8c64-79e77c6f45ed service nova] Creating event network-changed:a2eae374-e3ba-47c3-86c8-1a2f361f6348 for instance fb5c83d8-77a0-4ea2-b589-783e1a097f63 on hv-cinder-84713 Jun 22 10:42:25.467243 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-a2ad0616-9328-4116-87e5-e1fe686dfd12 req-b7d7dcf8-beba-472b-8c64-79e77c6f45ed service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057248 Jun 22 10:42:25.468629 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 560/1140] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:42:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 22 10:42:25.593477 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-481b2398-441e-4cbc-8f97-ecd3e785364a tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:42:25.594003 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-481b2398-441e-4cbc-8f97-ecd3e785364a tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] [instance: fb5c83d8-77a0-4ea2-b589-783e1a097f63] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:42:25.611529 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-481b2398-441e-4cbc-8f97-ecd3e785364a tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:42:25.612266 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-481b2398-441e-4cbc-8f97-ecd3e785364a tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:42:25.613937 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-481b2398-441e-4cbc-8f97-ecd3e785364a tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:42:25.614783 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-481b2398-441e-4cbc-8f97-ecd3e785364a tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:42:25.661991 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-481b2398-441e-4cbc-8f97-ecd3e785364a tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] [instance: fb5c83d8-77a0-4ea2-b589-783e1a097f63] Going to try to terminate instance {{(pid=117680) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 22 10:42:25.774302 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-481b2398-441e-4cbc-8f97-ecd3e785364a tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] 10.222.0.66 "DELETE /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63" status: 204 len: 0 microversion: 2.1 time: 0.365307 Jun 22 10:42:25.775789 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 581/1141] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Jun 22 10:42:25 2022] DELETE /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 22 10:42:25.786915 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-68620b97-320b-4414-87df-fc1632346f27 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:42:25.787646 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-68620b97-320b-4414-87df-fc1632346f27 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] [instance: fb5c83d8-77a0-4ea2-b589-783e1a097f63] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:42:25.795127 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-68620b97-320b-4414-87df-fc1632346f27 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:42:25.795580 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-68620b97-320b-4414-87df-fc1632346f27 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:42:25.796413 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-68620b97-320b-4414-87df-fc1632346f27 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:42:25.796862 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-68620b97-320b-4414-87df-fc1632346f27 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:42:25.966727 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.policy [None req-68620b97-320b-4414-87df-fc1632346f27 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed25916e1a4c05a671992fe8f0d675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51887577477404e9595e11feff3da23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117679) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:42:25.980802 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-68620b97-320b-4414-87df-fc1632346f27 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] 10.222.0.66 "GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63" status: 200 len: 1567 microversion: 2.1 time: 0.198094 Jun 22 10:42:25.981872 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 561/1142] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:42:25 2022] GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63 => generated 1567 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 22 10:42:26.740551 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 10:42:26.740551 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Wed Jun 22 10:42:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 10:42:27.016700 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-8cb2a608-bf0e-4587-b868-67a058214315 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:42:27.018908 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-8cb2a608-bf0e-4587-b868-67a058214315 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] [instance: fb5c83d8-77a0-4ea2-b589-783e1a097f63] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:42:27.026357 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8cb2a608-bf0e-4587-b868-67a058214315 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:42:27.026948 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8cb2a608-bf0e-4587-b868-67a058214315 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:42:27.027791 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8cb2a608-bf0e-4587-b868-67a058214315 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:42:27.028603 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-8cb2a608-bf0e-4587-b868-67a058214315 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:42:27.354247 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-8cb2a608-bf0e-4587-b868-67a058214315 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed25916e1a4c05a671992fe8f0d675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51887577477404e9595e11feff3da23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:42:27.365842 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-8cb2a608-bf0e-4587-b868-67a058214315 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] 10.222.0.66 "GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63" status: 200 len: 1567 microversion: 2.1 time: 0.356970 Jun 22 10:42:27.367628 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 582/1143] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:42:27 2022] GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63 => generated 1567 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:42:28.042561 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [req-860f062e-a521-4efd-9182-b59f1ddc8cf1 req-1d78f34b-f7df-4699-815d-cc45d714ad4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb5c83d8-77a0-4ea2-b589-783e1a097f63", "name": "network-vif-deleted", "tag": "a2eae374-e3ba-47c3-86c8-1a2f361f6348"}]} {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 22 10:42:28.053196 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-860f062e-a521-4efd-9182-b59f1ddc8cf1 req-1d78f34b-f7df-4699-815d-cc45d714ad4c service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:42:28.053649 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [req-860f062e-a521-4efd-9182-b59f1ddc8cf1 req-1d78f34b-f7df-4699-815d-cc45d714ad4c service nova] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:42:28.067297 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.compute.server_external_events [req-860f062e-a521-4efd-9182-b59f1ddc8cf1 req-1d78f34b-f7df-4699-815d-cc45d714ad4c service nova] Creating event network-vif-deleted:a2eae374-e3ba-47c3-86c8-1a2f361f6348 for instance fb5c83d8-77a0-4ea2-b589-783e1a097f63 on hv-cinder-84713 Jun 22 10:42:28.072927 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [req-860f062e-a521-4efd-9182-b59f1ddc8cf1 req-1d78f34b-f7df-4699-815d-cc45d714ad4c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116459 Jun 22 10:42:28.073803 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 562/1144] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Jun 22 10:42:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 22 10:42:28.394553 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-6e03300a-3673-4074-a82a-397182005e96 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Calling method '>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:42:28.397183 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.compute.api [None req-6e03300a-3673-4074-a82a-397182005e96 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] [instance: fb5c83d8-77a0-4ea2-b589-783e1a097f63] Fetching instance by UUID {{(pid=117680) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:42:28.410862 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6e03300a-3673-4074-a82a-397182005e96 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:42:28.411596 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6e03300a-3673-4074-a82a-397182005e96 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:42:28.412737 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6e03300a-3673-4074-a82a-397182005e96 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:42:28.413408 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6e03300a-3673-4074-a82a-397182005e96 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:42:28.473656 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6e03300a-3673-4074-a82a-397182005e96 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:42:28.474218 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG oslo_concurrency.lockutils [None req-6e03300a-3673-4074-a82a-397182005e96 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117680) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:42:28.474845 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.objects.instance [None req-6e03300a-3673-4074-a82a-397182005e96 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lazy-loading 'fault' on Instance uuid fb5c83d8-77a0-4ea2-b589-783e1a097f63 {{(pid=117680) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 22 10:42:28.543659 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.policy [None req-6e03300a-3673-4074-a82a-397182005e96 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bed25916e1a4c05a671992fe8f0d675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51887577477404e9595e11feff3da23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117680) authorize /opt/stack/nova/nova/policy.py:199}} Jun 22 10:42:28.551751 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-6e03300a-3673-4074-a82a-397182005e96 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] 10.222.0.66 "GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63" status: 200 len: 1224 microversion: 2.1 time: 0.168193 Jun 22 10:42:28.552355 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 583/1145] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:42:28 2022] GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63 => generated 1224 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 22 10:42:29.571343 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-3d9c7936-be36-4b28-8781-96e18b58ce7d tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Calling method '>' {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:42:29.572115 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.compute.api [None req-3d9c7936-be36-4b28-8781-96e18b58ce7d tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] [instance: fb5c83d8-77a0-4ea2-b589-783e1a097f63] Fetching instance by UUID {{(pid=117679) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 22 10:42:29.579829 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3d9c7936-be36-4b28-8781-96e18b58ce7d tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:42:29.580339 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3d9c7936-be36-4b28-8781-96e18b58ce7d tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:42:29.581178 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3d9c7936-be36-4b28-8781-96e18b58ce7d tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 22 10:42:29.581679 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG oslo_concurrency.lockutils [None req-3d9c7936-be36-4b28-8781-96e18b58ce7d tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Lock "99dc5dbe-6aa5-4c21-a61e-113fd190a23f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117679) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 22 10:42:29.597785 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.wsgi [None req-3d9c7936-be36-4b28-8781-96e18b58ce7d tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] HTTP exception thrown: Instance fb5c83d8-77a0-4ea2-b589-783e1a097f63 could not be found. Jun 22 10:42:29.599566 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-3d9c7936-be36-4b28-8781-96e18b58ce7d tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Request method failure captured: Jun 22 10:42:29.599566 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: request: GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63 HTTP/1.1 Jun 22 10:42:29.599566 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Accept: application/json Jun 22 10:42:29.599566 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Accept-Encoding: identity Jun 22 10:42:29.599566 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Connection: close Jun 22 10:42:29.599566 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Content-Length: 0 Jun 22 10:42:29.599566 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Content-Type: application/json Jun 22 10:42:29.599566 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Host: 10.222.0.66 Jun 22 10:42:29.599566 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Openstack-System-Scope: None Jun 22 10:42:29.599566 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: User-Agent: python-urllib3/1.26.9 Jun 22 10:42:29.599566 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Auth-Token: gAAAAABisvDdx7gT1BzqFXYIKh4uYsa3WIEUus-NNh-gjZoUDkHY57Ttkmck1LL9PhbbUUlF9jS8WhiPaHD2QaoVc5oVJS__sPEMbwMwuBNWDuHrZcSrHi5yz9ZJtJWeQ1pOuaKnCztXj_8Y_YQ59_uJB-2WFVsTDTxb_zbUCvFvOofcwsVY2fQ Jun 22 10:42:29.599566 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Domain-Id: None Jun 22 10:42:29.599566 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Domain-Name: None Jun 22 10:42:29.599566 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Identity-Status: Confirmed Jun 22 10:42:29.599566 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Is-Admin-Project: True Jun 22 10:42:29.599566 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Domain-Id: default Jun 22 10:42:29.599566 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Domain-Name: Default Jun 22 10:42:29.599566 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Id: d51887577477404e9595e11feff3da23 Jun 22 10:42:29.599566 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Project-Name: tempest-TestShelveInstance-2011878087 Jun 22 10:42:29.599566 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Role: member,reader Jun 22 10:42:29.599566 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Roles: member,reader Jun 22 10:42:29.602289 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_d51887577477404e9595e11feff3da23"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d51887577477404e9595e11feff3da23"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/d51887577477404e9595e11feff3da23"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d51887577477404e9595e11feff3da23"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}] Jun 22 10:42:29.602289 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Tenant: tempest-TestShelveInstance-2011878087 Jun 22 10:42:29.602289 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Tenant-Id: d51887577477404e9595e11feff3da23 Jun 22 10:42:29.602289 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-Tenant-Name: tempest-TestShelveInstance-2011878087 Jun 22 10:42:29.602289 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User: tempest-TestShelveInstance-2011878087-project Jun 22 10:42:29.602289 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Domain-Id: default Jun 22 10:42:29.602289 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Domain-Name: Default Jun 22 10:42:29.602289 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Id: 2bed25916e1a4c05a671992fe8f0d675 Jun 22 10:42:29.602289 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: X-User-Name: tempest-TestShelveInstance-2011878087-project Jun 22 10:42:29.602289 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: method: > Jun 22 10:42:29.602289 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: exception: Instance fb5c83d8-77a0-4ea2-b589-783e1a097f63 could not be found. Jun 22 10:42:29.602289 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: action_args: {'id': 'fb5c83d8-77a0-4ea2-b589-783e1a097f63'} Jun 22 10:42:29.604262 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: {{(pid=117679) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 22 10:42:29.604262 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:42:29.604262 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 22 10:42:29.604262 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 22 10:42:29.604262 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 22 10:42:29.604262 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 22 10:42:29.604262 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 22 10:42:29.604262 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 22 10:42:29.604262 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 22 10:42:29.604262 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 22 10:42:29.604262 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb5c83d8-77a0-4ea2-b589-783e1a097f63 could not be found. Jun 22 10:42:29.604262 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:42:29.604262 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:42:29.604262 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:42:29.604262 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:42:29.604262 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:42:29.604262 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:42:29.604262 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 22 10:42:29.604262 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 22 10:42:29.604262 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 22 10:42:29.607613 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 22 10:42:29.607613 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 22 10:42:29.607613 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 22 10:42:29.607613 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 22 10:42:29.607613 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 22 10:42:29.607613 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 22 10:42:29.607613 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 22 10:42:29.607613 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb5c83d8-77a0-4ea2-b589-783e1a097f63 could not be found. Jun 22 10:42:29.607613 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:42:29.607613 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 22 10:42:29.607613 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:42:29.607613 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 22 10:42:29.607613 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 22 10:42:29.607613 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 22 10:42:29.607613 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 22 10:42:29.607613 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 22 10:42:29.607613 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb5c83d8-77a0-4ea2-b589-783e1a097f63 could not be found. Jun 22 10:42:29.607613 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: ERROR nova.api.openstack.wsgi Jun 22 10:42:29.610303 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: DEBUG nova.api.openstack.wsgi [None req-3d9c7936-be36-4b28-8781-96e18b58ce7d tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Returning 404 to user: Instance fb5c83d8-77a0-4ea2-b589-783e1a097f63 could not be found. {{(pid=117679) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 22 10:42:29.610303 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO nova.api.openstack.requestlog [None req-3d9c7936-be36-4b28-8781-96e18b58ce7d tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] 10.222.0.66 "GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63" status: 404 len: 111 microversion: 2.1 time: 0.034969 Jun 22 10:42:29.610303 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: [pid: 117679|app: 0|req: 563/1146] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Jun 22 10:42:29 2022] GET /compute/v2.1/servers/fb5c83d8-77a0-4ea2-b589-783e1a097f63 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 22 10:42:29.879083 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: DEBUG nova.api.openstack.wsgi [None req-5f7d56cd-3a3b-4404-8ea8-38d3709585b1 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] Calling method '.version_select at 0x7f60d9700c10>' {{(pid=117680) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 22 10:42:29.885082 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5f7d56cd-3a3b-4404-8ea8-38d3709585b1 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] [e068921b-e2ef-4371-9edc-d49975f8cab5] AMQP server on 10.222.0.66:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 22 10:42:30.894640 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO oslo.messaging._drivers.impl_rabbit [None req-5f7d56cd-3a3b-4404-8ea8-38d3709585b1 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] [e068921b-e2ef-4371-9edc-d49975f8cab5] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 44744. Jun 22 10:42:30.917473 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO nova.api.openstack.requestlog [None req-5f7d56cd-3a3b-4404-8ea8-38d3709585b1 tempest-TestShelveInstance-2011878087 tempest-TestShelveInstance-2011878087-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-248844381" status: 202 len: 0 microversion: 2.1 time: 1.043541 Jun 22 10:42:30.918350 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: [pid: 117680|app: 0|req: 584/1147] 10.222.0.66 () {58 vars in 1250 bytes} [Wed Jun 22 10:42:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-248844381 => generated 0 bytes in 1045 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 22 10:44:19.123867 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 10:44:19.124773 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Wed Jun 22 10:44:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 10:45:45.866584 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 10:45:45.867334 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Wed Jun 22 10:45:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 10:45:46.750271 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 10:45:46.750271 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Wed Jun 22 10:45:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 10:45:50.907046 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 10:45:50.907872 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Wed Jun 22 10:45:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 10:47:39.133324 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 10:47:39.134460 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Wed Jun 22 10:47:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 10:47:45.375823 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 10:47:45.376677 dv-cinder-847132-1-iscsi devstack@n-api.service[117680]: Wed Jun 22 10:47:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 22 10:47:59.930036 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 22 10:47:59.930716 dv-cinder-847132-1-iscsi devstack@n-api.service[117679]: Wed Jun 22 10:47:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!